Methods for Developing Patient-Reported Outcome-Based Performance Measures (PRO-PMs)

Exploring patients' experience using PROMs within routine post-discharge follow-up assessment after stroke: a mixed methods approach

BACKGROUND

Patient Reported Outcomes Measures (PROMs) are being used increasingly to measure health problems in stroke clinical practice. However, the implementation of these PROMs in routine stroke care is still in its infancy. To understand the value of PROMs used in ischemic stroke care, we explored the patients' experience with PROMs and with the consultation at routine post-discharge follow-up after stroke.

METHODS

In this prospective mixed methods study, patients with ischemic stroke completed an evaluation questionnaire about the use of PROMs and about their consultation in two Dutch hospitals. Additionally, telephone interviews were held to gain in-depth information about their experience with PROMs.

RESULTS

In total, 63 patients completed the evaluation questionnaire of which 10 patients were also interviewed. Most patients (82.2-96.6%) found completing the PROMs to be feasible and relevant. Half the patients (49.2-51.6%) considered the PROMs useful for the consultation and most patients (87.3-96.8%) reported the consultation as a positive experience. Completing the PROMs provided 51.6% of the patients with insight into their stroke-related problems. Almost 75% of the patients found the PROMs useful in giving the healthcare provider greater insight, and 60% reported discussing the PROM results during the consultation. Interviewed patients reported the added value of PROMs, particularly when arranging further care, in gaining a broader insight into the problems, and in ensuring all important topics were discussed during the consultation.

CONCLUSIONS

Completing PROMs appears to be feasible for patients with stroke attending post-discharge consultation; the vast majority of patients experienced added value for themselves or the healthcare provider. We recommend that healthcare providers discuss the PROM results with their patients to improve the value of PROMs for the patient. This could also improve the willingness to complete PROMs in the future.

Rasch analysis of a patient-reported outcome measure for self-perceived health among psychiatric patients in Denmark

BACKGROUND

Patient-reported outcome measures (PROMs) are valuable and necessary tools for establishing and maintaining patient-centred healthcare. The PRO-Psychiatry initiative was primarily initiated to support the patient's voice in treatment decision-making and secondarily to monitor patient-perceived quality of care. The result of the initiative is a patient-reported instrument developed in collaboration between patients and clinicians. We aimed to validate the PROM developed for measuring self-perceived health among psychiatric patients in North Denmark Region, in terms of internal consistency, criterion validity and responsiveness.

METHOD

Patients in contact with a psychiatric hospital in the North Denmark Region from September 2018 to March 2021 were included in the study. The PROM constitutes a scale of 17 items covering various aspects of self-perceived health including well-being (7 items), lack of well-being (5 items) and social functioning (5 items), where the former domain entails the WHO-5 Well-Being Index. The potential range of the total scale score is 0-85. We applied McDonald's omega, average inter-item correlation (AIIC) and differential item functioning (DIF). In addition, we used mixed effects analyses to estimate temporal correlations. The instrument was compared with self-rated overall mental and psychiatric health.

RESULTS

The patient population consisted of 1132 unique patients and a total of 2476 responses corresponding to one response per patient pathway. McDonald's omega was found to be 0.92 (95% CI 0.92 to 0.93), while the AIIC was found to be 0.42 (95% CI 0.39 to 0.44). For DIF, the largest systematic variation resulted in a maximum difference of 2.3 points on the total score when adjusting for the latent trait and was found when comparing initial measurements with follow-up measurements. The correlation between the total score and the outcomes regarding overall physical and mental health was 0.52 (95% CI 0.48 to 0.56) and 0.74 (95% CI 0.72 to 0.76). Similar correlations were found for the corresponding changes over time.

CONCLUSION

The scale showed high consistency and little systematic variation between the comparison groups. The concurrent correlations and analyses of responsiveness coincided with the prespecified hypotheses. Overall, we deem the Danish PRO-Psychiatry instrument to possess suitable psychometric properties for measuring self-perceived health among a psychiatric population.

Physician Estimates and Patient-Reported Health Status in Atrial Fibrillation

Importance

A primary objective in managing atrial fibrillation (AF) is to optimize patients' health status, which can be done only if physicians accurately quantify the outcomes associated with AF in patients' lives.

Objective

To explore physicians' estimation of the health status of patients with AF and its association with subsequent care and outcomes.

Design, Setting, and Participants

A multicenter, prospective cohort study was conducted in 2 outpatient practices in Tokyo, Japan. Participants included patients with newly diagnosed AF or those referred for initial treatment of AF at outpatient practices and treating physicians from November 8, 2018, to April 1, 2020. Data analysis was performed from December 22, 2022, to July 7, 2023.

Exposures

Participating patients completed the Atrial Fibrillation Effect on Quality-of-Life (AFEQT) questionnaire, a 20-item tool covering 4 domains with a 7-point Likert scale; 3 domains (symptoms, daily activities, and treatment concerns) were used in this study. Blinded to patients' responses, treating physicians answered a 3-item questionnaire quantifying each patient's AFEQT domain with a single item. Patients' mean Likert scale responses within each AFEQT domain were subtracted from the physicians' assessments so that higher scores (≥0.5 points) indicate physician underestimation, while lower scores (≤0.5 points) indicate physician overestimation of the health status of patients with AF.

Main Outcomes and Measures

The independent association of physician-patient concordance with treatment escalation (alteration or initiation of antiarrhythmic drugs, cardioversion, or catheter ablation) and 1-year adjusted changes in AFEQT scores.

Results

Among 330 patients (238 [72.1%] men; mean [SD] age, 67.9 [11.9] years; 163 [49.4%] with paroxysmal AF), physicians correctly estimated health status in 112 patients (33.9%), underestimated it in 42 patients (12.7%), and overestimated it in 176 patients (53.3%). Treatment escalation occurred in 63.6% of patients whose health status was correctly estimated, 47.6% of those whose health status was underestimated, and 66.3% of patients whose health status was overestimated. After multivariable adjustment, underestimation of health status was independently associated with less treatment escalation (adjusted odds ratio, 0.43; 95% CI, 0.20-0.90) and less frequent AFEQT overall summary score improvement at 1 year (underestimated, 2.5 [95% CI, -1.6 to 6.7] vs correctly and overestimated health status, 8.4 [95% CI, 7.0-9.9] points; P = .01).

Conclusions and Relevance

In this cohort study, physician underestimation of the health status of patients with AF was common and associated with less aggressive treatment and less health status improvement at 1 year.

Patient-Reported Outcome-Based Performance Measures in Alternative Payment Models: Current Use, Implementation Barriers, and Principles to Succeed

OBJECTIVES

Patient-reported outcome (PRO)-based performance measures (PRO-PMs) offer opportunities to aggregate survey data into a reliable and valid assessment of performance at the entity-level (eg, clinician, hospital, and accountable care organization). Our objective was to address the existing literature gap regarding the implementation barriers, current use, and principles for PRO-PMs to succeed.

METHODS

As quality measurement experts, we first highlighted key principles of PRO-PMs and how alternative payment models (APMs) may be integral in promoting more widespread use. In May 2023, we reviewed the Centers for Medicare and Medicaid Services (CMS) Measures Inventory Tool for active PRO-PM usage within CMS programs. We finally present principles to prioritize as part PRO-PMs succeeding within APMs.

RESULTS

We identified 5 implementation barriers to PRO-PM use: original development of instrument, response rate sufficiency, provider burden, hesitancy regarding fairness, and attribution of desired outcomes. There existed 54 instances of active PRO-PM usage across CMS programs, including 46 unique PRO-PMs within 14 CMS programs. Five principles to prioritize as part of greater PRO-PM development and incorporation within APMs include the following: (1) clinical salience, (2) adequate sample size, (3) meaningful range of performance among measured entities and the ability to detect performance change in a reasonable time frame, (4) equity focus, and (5) appropriate risk adjustment.

CONCLUSIONS

Identified barriers and principles to prioritize should be considered during PRO-PM development and implementation phases to link available and novel measures to payment programs while ensuring provider and stakeholder engagement.

Study protocol for the validation of a new pictorial functional scale in patients with knee osteoarthritis: the functional activity scoring tool (FAST)

BACKGROUND

Patient-reported outcome measures (PROMs) are required for patient-centred care. There are limited PROMs with good psychometric properties, and limitations to any language-based scale are often constrained by the written words or numerals used. Therefore, we developed the Functional Activity Scoring Tool (FAST), a self-reporting pictorial scale. FAST measures the impact of knee osteoarthritis on essential activities of daily living (ADL) and the significant changes in the self-perceived functional status over time.

OBJECTIVES

This study aims to (1) develop FAST with adaptation from the Wong-Baker FACES pain rating scale, (2) validate FAST against the Patient-Specific Functional Scale (PSFS) and Knee Injury and Osteoarthritis Outcome Score (KOOS) and (3) establish the reliability, validity and responsiveness of FAST in individuals with knee osteoarthritis.

METHODS AND ANALYSIS

The prospective study protocol investigates the validity, responsiveness and reliability of FAST. The PSFS and KOOS will be gold standard comparisons. Participant recruitment will occur at four public polyclinics that offer physiotherapy outpatient services in Singapore. Onsite physiotherapists familiar with the study eligibilities will refer potential participants to the investigators after the routine physiotherapy assessment. After providing written consent, eligible participants will complete outcome measurements with FAST, the PSFS and KOOS during baseline and follow-up assessments. The Global Rating of Change (GROC) scale will determine how the participant's knee status was changed compared with the beginning of the physiotherapy intervention.

ETHICS AND DISSEMINATION

SingHealth Centralised Institutional Review Board approved the study (CIRB reference number: 2022/2602). The final results will be published via scientific publication. FAST will benefit the evaluation and management of those who suffer knee osteoarthritis regardless of English proficiency or language barriers.

TRIAL REGISTRATION NUMBER

NCT05590663.

Patient-Reported Outcomes Following Severe Abdominal Trauma: A Secondary Analysis of the Damage Control Laparotomy Trial

INTRODUCTION

Little is known about patient-reported outcomes (PROs) following abdominal trauma. We hypothesized that patients undergoing definitive laparotomy (DEF) would have better PROs compared to those treated with damage control laparotomy (DCL).

METHODS

The DCL Trial randomized DEF versus DCL in abdominal trauma. PROs were measured using the European Quality of Life-5 Dimensions-5 Levels (EQ-5D) questionnaire at discharge and six months postdischarge (1 = perfect health, 0 = death, and <0 = worse than death) and Posttraumatic Stress Disorder (PTSD) Checklist-Civilian. Unadjusted Bayesian analysis with a neutral prior was used to assess the posterior probability of achieving minimal clinically important difference.

RESULTS

Of 39 randomized patients (21 DEF versus 18 DCL), 8 patients died (7 DEF versus 1 DCL). Of those who survived, 28 completed the EQ-5D at discharge (12 DEF versus 16 DCL) and 25 at 6 mo (12 DEF versus 13 DCL). Most patients were male (79%) with a median age of 30 (interquartile range (IQR) 21-42), suffered blunt injury (56%), and were severely injured (median injury severity score 33, IQR 21 - 42). Median EQ-5D value at discharge was 0.20 (IQR 0.06 - 0.52) DEF versus 0.31 (IQR -0.03 - 0.43) DCL, and at six months 0.51 (IQR 0.30 - 0.74) DEF versus 0.50 (IQR 0.28 - 0.84) DCL. The posterior probability of minimal clinically important difference DEF versus DCL at discharge and six months was 16% and 23%, respectively.

CONCLUSIONS

Functional deficits for trauma patients persist beyond the acute setting regardless of laparotomy status. These deficits warrant longitudinal studies to better inform patients on recovery expectations.

Patient-Reported Outcomes in Venous Thromboembolism: A Systematic Review of the Literature, Current Challenges, and Ways Forward

BACKGROUND

Venous thromboembolism (VTE) affects >1.2 million Americans annually. Although the clinical outcomes and economic burdens of VTE have been well described, the impact of VTE on patients' health status has yet to be summarized. This systematic review summarizes how patient-reported outcome measures (PROMs) have been used in VTE to date.

METHODS AND RESULTS

PubMed/MEDLINE was queried for literature published through March 2023 using PROMs in a population of patients with VTE. Studies were excluded if the reference was an editorial, review, or case report, or if the study included patients with conditions other than VTE. Qualitative analyses were performed. After screening and exclusion, 136 references were identified; 5 described PROM development, 20 focused on PROM validation, and 111 used PROMs in outcomes research. The most used generic PROMs were the 36-item Short-Form Health Survey and EuroQol 5-dimensional questionnaire, and the most common disease-specific PROMs were the Venous Insufficiency Epidemiological and Economic Study-Quality of Life/Symptoms and the Pulmonary Embolism Quality of Life Questionnaire. PROMs were used to quantify the changes in health status after diagnosis, characterize the trajectory of subsequent improvement, and identify drivers of continued impairments in health status like postthrombotic syndrome and postpulmonary embolism syndrome. PROMs were also used to investigate the impact of novel treatment modalities on quality of life.

CONCLUSIONS

This review demonstrates the many benefits of PROM use, including quantifying changes in health status with treatment, capturing patients' experiences with the treatment itself, and identifying complications of VTE. Incorporating PROMs into VTE care will be an essential component of evaluating the effectiveness of novel therapies and should lead to improved shared decision-making for patients with VTE.

Development of Quality of Life in Adolescents and Young Adults With Cancer Using a Patient Support Smartphone App: Prepost Interventional Study

BACKGROUND

Adolescents and young adults often experience existential concerns in addition to side effects during a cancer trajectory, which they often carry alone. Thus, cohesion with other adolescents and young adults with cancer is essential but difficult due to the relatively small, widely dispersed nationwide population. In cocreation, a smartphone app has been developed and includes an information bank, a symptom tracker, and a social community platform, aiming to improve the quality of life (QoL) in this patient group.

OBJECTIVE

This nationwide, multicenter study aimed to investigate the QoL in adolescents and young adults undergoing a cancer trajectory as they used the app for 6 weeks.

METHODS

Via youth support initiatives, participants were recruited from hospitals in all regions of Denmark. Inclusion criteria were patients with cancer aged 15-29 years who either initiated any cancer treatment or started follow-up after cancer treatment within 30 days. Participants used the adolescents and young adults cancer app for 6 weeks. Before and after the 6 weeks of app use, they completed the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire Core 30 (EORTC QLQ-C30). The participants were divided into a treatment and a follow-up group for analysis. A high score for a functional scale or the global health or overall QoL represents a high or healthy level of functioning or high QoL, respectively; however, a high score for a symptom scale or item represents a high level of symptomatology.

RESULTS

Overall, 81 participants were recruited. However, 4 participants did not answer the questionnaire and 6 participants did not use the app. In the treatment group (n=36), significant improvement was found in 2 domains: "Role functioning" (baseline median 33.33, IQR 16.67-83.33 vs 6 weeks median 66.67, IQR 33.33-83.33; P=.04) and "Pain" (baseline median 33.33, IQR 16.67-50.00 vs 6 weeks median 16.67, IQR 0.00-33.33; P=.04). The "Global health/Overall QoL" scale remained stable (baseline median 58.33, IQR 45.83-77.08 vs 6 weeks median 62.50, IQR 41.67-75.00; P=.25). In the follow-up group (n=35), significant improvement was found in 3 domains: "Physical functioning" (baseline median 79.23, IQR 73.33-93.33 vs 6 weeks median 82.86, IQR 73.33-100.00; P=.03), "Cognitive functioning" (baseline median 62.38, IQR 50.00-83.33 vs 6 weeks median 69.52, IQR 50.00-100.00; P=.02), and "Social functioning" (baseline median 76.19, IQR 50.00-100.00 vs 6 weeks median 85.71, IQR 83.33-100.00; P=.05), as well as in the "Global health/Overall QoL" scale (baseline median 57.14, IQR 83.33-100.00 vs 6 weeks median 75.0, IQR 62.91-85.73; P<.001).

CONCLUSIONS

In this study, we found an improvement in specific QoL scales for both participants in treatment and follow-up when using the app for 6 weeks. The global health or overall QoL score improved significantly in the follow-up group. In the treatment group, it remained stable.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/10098.

Agreement between physician- and patient-reported Canadian cardiovascular society scores among patients undergoing elective coronary angiography-The CATS study

The primary aim of revascularization in stable coronary artery disease (CAD) is symptom relief. The severity of symptoms is usually evaluated by the physician, not by the patient. We examined the agreement between physician- and patient-reported Canadian Cardiovascular Society (CCS) scores among patients scheduled for elective coronary angiography in a cross-sectional study. Patients (n = 650) and cardiologists evaluated the severity of angina symptoms by filling the CCS questionnaire before coronary angiography. Patients were divided into those without CAD (stenosis diameter <50%, n = 445) and those with CAD (stenosis diameter >50%, n = 205). CAD patients were further divided into three groups according to disease severity (single-, double- or triple-vessel disease). The mean age of the patients was 67.6 (9.9) years and 50.6% were women. In 51.8% (95% CI 44.5%-59.0%) of patients with CAD and 51.9% (95% CI 47.0%-56.8%) of those without, physician- and patient reported CCS scores agreed. The physician reported better CCS scores in 33.9% (95% CI 27.6%-40.7%) of patients with CAD and 36.2% (95% CI 31.8%-41.0%) of patients without CAD. The proportions of full or partial agreement between physician- and patient reported CCS scores were similar across the CAD severity groups. To summarize, we observed a significant discrepancy between the physician- and patient-reported symptom severity in patients with or without CAD scheduled for angiography. The physician underestimated the symptoms in third of the cases. Thus, patient-reported symptom severity, rather than physician's evaluation, should be the cornerstone of treatment decisions.

Baseline Health Status and its Association With Subsequent Cardiovascular Events in Patients With Atrial Fibrillation

BACKGROUND

Clinical practice guidelines recommend optimizing the health status of patients with atrial fibrillation (AF) as a primary treatment goal. Whether disease-specific health status is associated with subsequent clinical events is unknown.

OBJECTIVES

The aim of this study was to investigate the association between health status and subsequent clinical events among patients with AF.

METHODS

Using a prospective cohort study of patients with new-onset AF referred to 11 hospitals (n = 3,313, 68.4% men, mean age 67.8 ± 11.6 years), data were extracted from 3,296 patients (99.4%) who completed the disease-specific Atrial Fibrillation Effects on Quality-of-Life (AFEQT) questionnaire between 2012 and 2018. Factors associated with baseline AFEQT overall summary (OS) score and associations between major adverse cardiovascular or neurologic events (MACNE; a composite of all-cause death, stroke, or new-onset heart failure hospitalization) over 2 years were investigated.

RESULTS

Overall, 517 participants (15.6%) had poor to fair health status (AFEQT OS <60), and 1,035 (31.2%) had fair to good health status (AFEQT OS 60 to <80) at baseline. Female sex, younger age, family history of AF, higher baseline heart rate, paroxysmal AF, initial visit to the emergency department, and history of heart failure were associated with lower AFEQT OS scores. Of those, 226 participants (6.8%) experienced MACNE; restricted cubic spline analysis with adjustment for factors associated with baseline AFEQT score showed a nonlinear increase in the risk for MACNE with AFEQT OS score <80. The strongest associations were observed for baseline AFEQT daily activity scores (for AFEQT daily activity score of <80 vs ≥80, HR: 1.65; 95% CI: 1.21-2.25).

CONCLUSIONS

Diminished health status in patients with AF is common and is independently associated with subsequent adverse cardiovascular events.

Patient-Reported Outcomes and Surgical Quality

Delivering high-quality surgical care requires knowing how best to define and measure quality in surgery. Patient-reported outcomes (PROs) enable surgeons, health care systems, and payers to understand meaningful health outcomes from the patient's perspective and can be measured using patient-reported outcome measures (PROMs). As a result, there is much interest in using PROMs in routine surgical care, to guide quality improvement and to inform reimbursement pay structures. This chapter defines PROs and PROMs, differentiates PROMs from other quality measures such as patient-reported experience measures, describes PROMs in the context of routine clinical care, and provides an overview of interpreting PROM data. This chapter also describes how PROMs may be applied to quality improvement and value-based reimbursement in surgery.

Understanding patient experience of chronic cough in interstitial lung disease

Rationale

Chronic cough is a common symptom in patients with interstitial lung disease (ILD), negatively contributing to health-related quality of life. Despite this, there is limited information and understanding on the experience of this group of patients with chronic cough. This study aimed to explore the symptom experiences for chronic cough in patients with ILD to identify its characteristics and impacts.

Methods

A qualitative study using semi-structured telephone interviews was undertaken in 16 adults with a diagnosis of ILD of any type and severity. Patients were recruited from a quaternary referral centre in Melbourne, Australia. Interviews were transcribed verbatim and coded by two researchers using thematic analysis.

Results

Patients (age range: 39-87 years, forced vital capacity: 53-107% predicted and diffusing capacity of the lung for carbon monoxide: 28-89% predicted) experienced a spectrum of cough severity and characteristics, including both dry and productive coughs. The impact of chronic cough included physical symptoms, social and emotional difficulties, and interference with work and vocational participation. Management strategies used to relieve cough included mucolytics, opiates, throat lozenges, warm drinks, pacing, breath control, relaxation exercises, movement, continuous positive airways pressure and supplemental oxygen. Patients expressed a need for further information and education regarding chronic cough, including its triggers and management.

Conclusions

This study highlights the experience and significance of chronic cough in patients with ILD. The nature and severity of chronic cough in patients with ILD appears to be more heterogeneous than previously described, with physical, social and emotional impacts contributing to symptom burden.

Clinical Validity of the PROMIS Healthcare Engagement 8-Item Short Form

BACKGROUND

Healthcare engagement is a key measurement target for value-based healthcare, but a reliable and valid patient-reported measure has not yet been widely adopted.

OBJECTIVE

To assess the validity of a newly developed patient-reported measure of healthcare engagement, the 8-item PROMIS Healthcare Engagement (PHE-8a).

DESIGN

Prospective cohort study of the association between healthcare engagement and quality of care over 1 year. We fit mixed effects models of quality indicators as a function of engagement scores, adjusting for age, race/ethnicity, rural residence, and risk scores.

PARTICIPANTS

National stratified random sample of 9552 Veterans receiving Veterans Health Administration care for chronic conditions (hypertension, diabetes) or mental health conditions (depression, post-traumatic stress disorder).

MAIN MEASURES

Patient experience: Consumer Assessment of Health Plans and Systems communication and self-management support composites; no-show rates for primary care and mental health appointments; use of patient portal My HealtheVet; and Healthcare Effectiveness Data and Information Set electronic quality measures: HbA1c poor control, controlling high blood pressure, and hyperlipidemia therapy adherence.

KEY RESULTS

Higher engagement scores were associated with better healthcare quality across all outcomes, with each 5-point increase (1/2 standard deviation) in engagement scores associated with statistically significant and clinically meaningful gains in quality. Across the continuum of low to high engagement scores, we observed a concomitant reduction in primary care no-show rates of 37% and 24% for mental health clinics; an increased likelihood of My HealtheVet use of 15.4%; and a decreased likelihood of poor diabetes control of 44%.

CONCLUSIONS

The PHE-8a is a brief, reliable, and valid patient-reported measure of healthcare engagement. These results confirm previously untested hypotheses that patient engagement can promote healthcare quality.

Outcomes for treatment of depression in the Veterans Health Administration: Rates of response and remission calculated from clinical and survey data

Healthcare Effectiveness Data and Information Set (HEDIS) quality measures for depression treatment aggregate Patient Health Questionnaire (PHQ)-9 data from routine clinical assessments recorded in electronic health records (EHR). To determine whether aggregated PHQ-9 data in US Veterans Health Administration (VHA) EHRs should be used to characterize the organization's performance, we compared rates for depression response and remission calculated from EHRs with rates calculated with data representing the underlying Veteran patient population estimated using Veterans Outcome Assessment (VOA) survey data. We analyzed data from initial assessments and 3-month follow-up for Veterans beginning treatment for depression. EHR data were available for only a minority of Veteran patients, and the group of Veterans with EHR data differed from the underlying Veteran patient population with respect to demographic and clinical characteristics. Aggregated rates of response and remission from EHR data were significantly different from estimates based on representative VOA data. The findings suggest that until patient-reported outcome from EHRs are available for a substantial majority of patients receiving care, aggregated measures of patient outcomes derived from these data cannot be assumed to be representative of the outcomes for the overall population, and they should not be used as outcome-based measures of quality or performance.

Achieving consensus on patient-reported outcome measures in clinical practice for inflammatory skin disorders

BACKGROUND

International Dermatology Outcome Measures and the American Academy of Dermatology recently agreed on a physician-reported global severity measure to demonstrate quality of care in inflammatory dermatoses.

OBJECTIVE

Because patient-reported outcome measures are also important, we aimed to achieve consensus on 1 of these measures for clinical practice.

METHODS

Patients and providers participated in a consensus-building study involving a modified-Delphi technique. Voting was focused on identifying a minimal set of assessments for clinical practice, patient global assessments (PtGAs), Skindex instruments, and final instrument selection for quality improvement.

RESULTS

Among 53 stakeholders, >70% agreed that identification of patient goals, assessment of treatment harm, and assessment of the adequacy of treatment response were the minimal assessments needed for clinical practice. The most preferred PtGA was a 5-point PtGA (scale 0-4; 0 = clear, 4 = severe) having an optional check-box for worst ever. A new metric to assess change since treatment initiation, which we called a trajectory measure, was proposed. Stakeholders preferred Skindex instruments over PtGAs and a trajectory measure for clinical practice.

LIMITATIONS

A small number of patients and caregivers were involved and a consensus was not reached on all items.

CONCLUSION

PtGAs as standalone measures do not adequately capture the patient's assessment of disease severity or the effect of care. The combination of a PtGA with a Skindex instrument or another measure of health-related quality of life might provide a more comprehensive evaluation of patients in clinical practice.

Advancing Peripheral Artery Disease Quality of Care and Outcomes Through Patient-Reported Health Status Assessment: A Scientific Statement From the American Heart Association

Peripheral artery disease (PAD) is chronic in nature, and individualized chronic disease management is a central focus of care. To accommodate this reality, tools to measure the impact and quality of the PAD care delivered are necessary. Patient-reported outcomes (PROs) and instruments to measure them, that is, PRO measures, have been well studied in the research and clinical trial context, but a shift toward integrating them into clinical practice has yet to take place. A framework to use PRO measures as indicators of the quality of PAD care delivered, that is, PRO performance measures (PRO-PMs), is provided in this scientific statement. Measurement goals to consider by PAD clinical phenotypes are provided, as well as an overview of potential benefits of adopting PRO-PMs in the clinical practice of PAD care, including reducing unwanted variability and promoting health equity. A central discussion with considerations for risk adjustment of PRO-PMs, individualized PAD care, and the need for patient engagement strategies is offered. Furthermore, necessary conditions in terms of required competencies and training to handle PRO-PM data are discussed because the interpretation and handling of these data come with great responsibility and consequences for designing care that adopts a broader framework of risk that goes beyond the inclusion of biomedical variables. To conclude, health system perspectives and an agenda to reach the next steps in the implementation of PRO-PMs in PAD care are offered.

Progress toward a performance measure for mental health based on a generic patient- reported outcome measure: Findings from the Veterans Outcome Assessment survey

We report on studies conducted to develop outcome-based performance measures (PROM-PMs) based on generic patient-reported outcome measures (PROMs) that could support strategies for quality improvement applicable to all patients in a mental health system. Data were from the Veterans Outcome Assessment Survey at baseline and three months for the Mental Component Score (MCS-12), a widely used measure of mental health-related quality of life, for 15,540 outpatients beginning treatment in General Mental Health clinics in 140 Veterans Affairs (VA) facilities. Mental health diagnoses from medical records were coded using hierarchical categories. Mental health staffing levels and quality measures were from administrative data. Changes in MCS-12 scores were associated with demographics, baseline scores, and diagnostic categories; in fully adjusted models, differences between facilities accounted for only 0.5% of the total variance between patients. There were small but significant associations of both baseline and changes in MCS-12 scores with staffing levels and administrative measures of the quality of care that support the potential value of adjusted measures of changes in MCS-12 as a PROM-PM. Remaining issues include the low proportion of variability that can be attributed to differences between facilities and the associations of staffing and quality with possible case-mix adjustment variables.

Employing cognitive interviewing to evaluate, improve and validate items for measuring the health-related quality of life of women diagnosed with ovarian cancer

Background

Use of patient-reported outcome measures in clinical settings facilitate the delivery of better health care to improve patient health outcomes. Previously collected qualitative data indicated themes that could inform items for a health-related quality of life measure. This study investigated the content validity of items for inclusion in a new health-related quality of life measure suitable for patients with ovarian cancer.

Methods

Cognitive interviewing techniques were used with fourteen women diagnosed with ovarian cancer and at different times since diagnosis, to evaluate items derived from the previously collected qualitative dataset. A set of draft items was administered via telephone, Zoom and WhatsApp app together with questions on item meaning and wording. Interviews were transcribed and thematically analysed.

Results

Four broad themes emerged in relation to the questionnaire construction and comprehension of items: intent and clarity, wording, relevance and context, and overall questionnaire construct. All draft items were adjusted based on the interview findings. A final set of 38 health-related quality of life items comprised 7 items describing physical health and functioning, 21 describing emotional wellbeing and 10 items describing social wellbeing; each rated on a five-point frequency response scale.

Conclusion

The items reflected a range of personal experiences associated with the patient clinical journey, creating a health-related quality of life tool specific to women diagnosed with ovarian cancer. The cognitive interviewing process established content validity for the tool, thereby, preparing it for field testing and evaluation of its psychometric properties. This study highlighted the fundamental role of cognitive interviewing during health-related quality of life questionnaire development to ensure that item content is grounded in patient feelings, functioning and meaning.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12905-022-01966-w.

Using Patient-Reported Outcome Measures to Evaluate Care for Patients With Inflammatory Chronic Rheumatic Disease

OBJECTIVES

Few countries integrate patient-reported outcome measures (PROMs) in routine performance assessment and those that do focus on elective surgery. This study addresses the challenges of using PROMs to evaluate care in chronic conditions. We set out a modeling strategy to assess the extent to which changes over time in self-reported health status by patients with inflammatory chronic rheumatic disease are related to their biological drug therapy and rheumatology center primarily responsible for their care.

METHODS

Using data from the Portuguese Register of Rheumatic Diseases, we assess health status using the Health Assessment Questionnaire-Disability Index for rheumatic patients receiving biological drugs between 2000 and 2017. We specify a fixed-effects model using the least squares dummy variables estimator.

RESULTS

Patients receiving infliximab or rituximab report lower health status than those on etanercept (the most common therapy) and patients in 4 of the 26 rheumatology centers report higher health status than those at other centers.

CONCLUSIONS

PROMs can be used for those with chronic conditions to provide the patient's perspective about the impact on their health status of the choice of drug therapy and care provider. Care for chronic patients might be improved if healthcare organizations monitor PROMs and engage in performance assessment initiatives on a routine basis.

Patient reported outcomes in genital gender-affirming surgery: the time is now

Transgender and non-binary (TGNB) individuals often experience gender dysphoria. TGNB individuals with gender dysphoria may undergo genital gender-affirming surgery including vaginoplasty, phalloplasty, or metoidioplasty so that their genitourinary anatomy is congruent with their experienced gender. Given decreasing social stigma and increasing coverage from private and public payers, there has been a rapid increase in genital gender-affirming surgery in the past few years. As the incidence of genital gender-affirming surgery increases, a concurrent increase in the development and utilization of patient reported outcome measurement tools is critical. To date, there is no systematic way to assess and measure patients' perspectives on their surgeries nor is there a validated measure to capture patient reported outcomes for TGNB individuals undergoing genital gender-affirming surgery. Without a systematic way to assess and measure patients' perspectives on their care, there may be fragmentation of care. This fragmentation may result in challenges to ensure patients' goals are at the forefront of shared- decision making. As we aim to increase access to surgical care for TGNB individuals, it is important to ensure this care is patient-centered and high-quality. The development of patient-reported outcomes for patients undergoing genital gender-affirming surgery is the first step in ensuring high quality patient-centered care. Herein, we discuss the critical need for development of validated patient reported outcome measures for transgender and non-binary patients undergoing genital reconstruction. We also propose a model of patient-engaged patient reported outcome measure development.

Patient-reported outcomes as hospital performance measures: the challenge of confounding and how to handle it

It is highly appealing to use patient-reported outcomes (PROs) as hospital performance measures; however, so far, the attention to key methodological issues has been limited. One of the most critical challenges when comparing PRO-based performance measures across providers is to rule out confounding. In this paper, we explain confounding and why it matters when comparing across providers. Using examples from studies, we present potential strategies for dealing with confounding when using PRO data at an aggregated level. We aim to give clinicians an overview of how confounding can be addressed in both the design stage (restriction, matching, self-controlled design and propensity score) and the analysis stage (stratification, standardization and multivariable adjustment, including multilevel analysis) of a study. We also briefly discuss strategies for confounding control when data on important confounders are missing or unavailable.

Evaluating the implementation and use of patient-reported outcome measures in a mental health hospital in Denmark: a qualitative study

BACKGROUND

Reporting of barriers and successes associated with the implementation and use of patient-reported outcomes (PROs) is limited as a means to ensure enhanced patient involvement, shared decision-making and improved treatment and care. We set out to evaluate the implementation and use of the PRO-Psychiatry initiative on patient-reported outcome measures in Danish mental health care. We aimed to described four specific areas: the quality of the clinical consultations before and after the implementation of PRO-Psychiatry as perceived by the patients (objective A), the motivation for participating in PRO-Psychiatry as perceived by patients and clinicians (objective B), the implementation process as perceived by patients, clinicians and managers (objective C) and suggestions for improvement (objective D).

METHODS

The PRO-Psychiatry initiative was evaluated through a participatory approach, including patients, clinicians and managers. A repeated cross-sectional interview-based survey explored the quality of the clinical consultation before and after the implementation of PRO-Psychiatry. A three-step semi-structured group interview, inspired by the modified mini-Delphi method, was used to establish consensus on the evaluation of the implementation and use of the initiative.

RESULTS

The evaluation pointed at PRO-Psychiatry as a meaningful initiative, which motivated patients and supported clinicians. The patients emphasised the importance of PROs, but they also found that PROs were not used enough. Clinically relevant improvements were detected after the implementation of the initiative; more patients felt heard and experienced that clinicians took a greater interest in their problems. The clinicians valued the easily accessible real-time graphical display of the PRO responses in the electronic health record (EHR). Clinicians and managers agreed that clinical PRO practices, patient compliance and use of PROs in treatment and care should be supported during implementation.

CONCLUSION

The evaluation was overall positive. Patients and clinicians were willing to participate, found the online reporting easy and valued the direct access to PRO responses in the EHR. An essential feature was the integration of well-defined and functional PRO practices into the existing clinical workflow. Using PROs in the clinical sessions in a way that was palpable to the patient was found to be a significant improvement need. At the individual level, PRO-Psychiatry can use patient outcome information to support dialogue, encourage shared decision-making and promote self-management during recovery. At the aggregated patient level, the PROs can be used for monitoring the patient-perceived quality of care and for research.

Barriers and Opportunities for Patient-Reported Outcome Implementation: A National Pediatrician Survey in the United States

Purpose: To characterize pediatricians’ perceived barriers and areas of confidence in assessing patient-reported outcomes (PROs) in the U.S., and to test associations of these factors with implementing PRO assessment. Methods: Using a random sample from the members of American Medical Association, we recruited general pediatricians and pediatric subspecialists to complete a survey (July 2011 to December 2013). Perceived barriers and confidence in PRO assessment were compared by age, pediatric specialty (general pediatrics, seven subspecialties), practice settings (academic, private), and region of practice. Multivariable logistic regressions tested associations of demographic factors, barriers, and confidence factors with the implementation of PRO assessment. Findings: The survey was completed by 458 participants (response rate 48.5%); of these, 40.4%, 15.9%, 15.5%, and 8.1% were general pediatricians, cardiology, hematology/oncology, and pulmonary specialists, respectively. PRO assessment was implemented by 29.0% of the pediatricians. The top five barriers for PRO assessment included limited time/manpower (79.0%), limited training (77.4%), lengthy PRO instruments (76%), lack of meaningful cut-offs on PRO scores (75.5%), and unavailable PRO instruments (75.0%). Limited knowledge of PROs (OR 4.10; 95% CI 2.21, 7.60) and unavailability of PRO instruments (OR 1.87; 95% CI 1.01, 3.49) increased the odds of not implementing the assessment, whereas confidence in PRO assessments compatible with norms (OR 0.41; 95% CI 0.23, 0.72) and perceived benefit over clinical judgment alone (OR 0.53; 95% CI 0.31, 0.93) decreased the odds of not implementing the assessment. Interpretation: significant barriers to PRO assessment in pediatric settings suggest the need for providing training, resources, and practical guidance toward implementation. Patient or Public Contribution: healthcare service users contributed to this study by completing a survey and providing feedback about the barriers and areas of confidence in assessing PROs for pediatric populations.

Development of a Disease-Specific Health-Related Quality of Life Questionnaire (DTF-QoL) for Patients with Desmoid-Type Fibromatosis

Simple Summary

Desmoid-type fibromatosis (DTF) is an uncommon soft-tissue tumour that is incapable of metastasising. Patients can experience a variety of physical and psychological symptoms, making assessment of health-related quality of life (HRQoL) highly relevant. Measuring the impact of DTF on HRQoL can be challenging due to the rare character and variable clinical presentation of the disease. Therefore, a HRQoL instrument assessing DTF-specific issues is needed. Previously, a provisional DTF-specific HRQoL tool was developed (the DTF-QoL). The aim of the current study was to pre-test the DTF-QoL. Pre-testing of the questionnaire led to the selection of 96 questions, conceptualised into three symptom subscales, eleven disease-impact subscales and six single items, together forming the final DTF-QoL. This questionnaire can be used in both clinical and research settings to evaluate HRQoL of DTF patients, which could help to provide personalised care and improve overall patient experience.

Abstract

Sporadic desmoid-type fibromatosis (DTF) is a rare, non-metastasising soft-tissue tumour. Patients can experience a variety of disease-specific issues related to the unpredictable clinical course and aggressiveness of DTF, which negatively impacts health-related quality of life (HRQoL). These DTF-specific issues are not captured by generic HRQoL tools. A 102-item provisional DTF-specific HRQoL tool, the DTF-QoL, was previously developed. The aim of this study was to pre-test the psychometric properties of the DTF-QoL by administering it together with the EORTC Quality of Life Questionnaire Core 30 (EORTC QLQ-C30) to 236 DTF patients from the United Kingdom and the Netherlands. Construct validity and reliability were determined based on factor analysis, multi-trait scaling analysis, Cronbach’s alpha, and correlations with the EORTC QLQ-C30 scales. Ninety-six items were selected, conceptualised into three symptom scales, eleven disease-impact scales and six single items, together forming the final DTF-QoL. Scaling assumptions were fully or moderately met for ten out of fourteen scales. Cronbach’s alpha ranged from 0.551–0.908. Most scales of the DTF-QoL were weakly or moderately correlated with the EORTC QLQ-C30. The DTF-QoL is a promising tool capturing the whole spectrum of DTF-specific issues. Implementation of the DTF-QoL in research and clinical practice will help to personalise HRQoL measurement and clinical care for DTF patients.

Performance of the PHQ-9 across conditions and comorbidities: Findings from the Veterans Outcome Assessment survey

BACKGROUND

The items of the Patient Health Questionnaire-9 (PHQ-9) represent the criterion symptoms for DSM-IV major depression. This study evaluated the extent to which the PHQ-9 functions as a patient-reported outcome measure (PROM) specific to patients with major depressive disorder.

METHOD

Data were from the Veterans Outcome Assessment survey for 8848 patients beginning treatment in VA general mental health clinics, including 5754, re-surveyed after 3 months. The PHQ-9's performance as a PROM was evaluated by comparing rank order correlations between both initial scores and improvements over 3 months between the PHQ-9 and several transdiagnostic PROMs across a range of diagnoses and comorbidities. Performance of PHQ-9-related patient-reported outcome-based performance measures (PROM-PM) were evaluated by comparing rates of response and remission across patient groups.

RESULTS

Correlations between the PHQ-9 and transdiagnostic measures were significant and comparable in magnitude across a range of diagnoses and for cases with depression with or without comorbidities. Rates of response and remission were comparable across most patient groups.

LIMITATIONS

Limitations include use of clinical diagnoses as recorded in health records, and the relatively short time between assessments.

CONCLUSIONS

In these settings, the PHQ-9 functions more as a general measure of symptoms or distress than as a disease-specific scale. This supports its use as a PROM for patients beyond those with major depression, including those with related diagnoses and those with comorbidities, and use of related PROM-PMs in clinical settings where diagnoses may not be precise and comorbidities may be common.

Development and Validation of Patient-Reported Outcome Measures (PROM) and Patient-Reported Experience Measures (PREM) in Home Respiratory Therapies: Oxygen Therapy, CPAP Treatment, Mechanical Ventilation, and Aerosol Therapy

Introduction

Home respiratory therapies (HRT) are treatments aimed at diseases that are generally chronic and that have a significant impact on the biopsychosocial aspects of patients' lives. No validated patient-reported outcome measures (PROM) and patient-reported experience measures (PREM) are available to assess the impact of these treatments on quality of life (QoL) in HRT. The objective of this work was to identify and validate PROMs and PREMs in HRT.

Methods

The process was divided into 5 stages: review of the literature, patient interviews, qualitative validation workshops, cognitive validation, and psychometric validation. For the identification of PROM and PREM, consensus techniques were used with patients, caregivers, specialist doctors, and therapists. The evaluation was based on items that were collected from questionnaires on diseases commonly treated with HRT techniques in clinical practice. The psychometric validation was analyzed by a team of psychologists trained in the methodology.

Results

For the literature review, 20 articles met the inclusion and exclusion criteria. After patient interviews, the research team selected 40 PROM items for each treatment from the total of 51 PROM questionnaires found for respiratory diseases. For the validation workshops, the list of selected items had to be reduced to a final number of 15. After the workshops, 8 preliminary questionnaires were drawn up (4 PROMs and 4 PREMs). A second validation round was then held and the questionnaires were modified with the list of PREMs and PROMs resulting from the whole process. The psychometric validation of PROM and PREM questionnaires for each of the therapies consisted of an exploratory factor analysis (EFA) and a confirmatory factor analysis (CFA). Overall, 1299 questionnaires answered by 650 patients were obtained.

Conclusions

A preliminary set of PREMs and PROMs associated with HRT with good reliability indexes was developed: Cronbach's alpha and Composite Reliability Index (CRI). These are questionnaires with a 5-point Likert scale that the patient can quickly complete and which provide excellent scores for acceptability, reliability, and validity in psychometric tests. This may offer HRT units a robust basis for better monitoring of patient outcomes and needs and improve healthcare quality and clinical outcomes.

Linking Scores with Patient-Reported Health Outcome Instruments:A VALIDATION STUDY AND COMPARISON OF THREE LINKING METHODS

The psychometric process used to establish a relationship between the scores of two (or more) instruments is generically referred to as linking. When two instruments with the same content and statistical test specifications are linked, these instruments are said to be equated. Linking and equating procedures have long been used for practical benefit in educational testing. In recent years, health outcome researchers have increasingly applied linking techniques to patient-reported outcome (PRO) data. However, these applications have some noteworthy purposes and associated methodological questions. Purposes for linking health outcomes include the harmonization of data across studies or settings (enabling increased power in hypothesis testing), the aggregation of summed score data by means of score crosswalk tables, and score conversion in clinical settings where new instruments are introduced, but an interpretable connection to historical data is needed. When two PRO instruments are linked, assumptions for equating are typically not met and the extent to which those assumptions are violated becomes a decision point around how (and whether) to proceed with linking. We demonstrate multiple linking procedures-equipercentile, unidimensional IRT calibration, and calibrated projection-with the Patient-Reported Outcomes Measurement Information System Depression bank and the Patient Health Questionnaire-9. We validate this link across two samples and simulate different instrument correlation levels to provide guidance around which linking method is preferred. Finally, we discuss some remaining issues and directions for psychometric research in linking PRO instruments.

Stakeholder Perceptions of Key Aspects of High-Quality Cancer Care to Assess with Patient Reported Outcome Measures: A Systematic Review

Simple Summary

We conducted a review to identify important symptoms reported by patients on questionnaires (e.g., pain) that can be used to compare cancer centers on how well they provide care. For example, cancer centers could be compared on the percentage of patients with controlled pain after adjusting for demographic and clinical characteristics. Standard review methods were used to identify studies through August 2020. Searches generated 1813 articles and 1779 were coded as not relevant. The remaining 34 studies showed that patients, caregivers, clinicians, and healthcare administrators identify psychosocial care (e.g., distress) and symptom management as critical parts of high-quality care. Patients and caregivers also perceive that maintaining physical function and daily activities are important. Clinicians and healthcare administrators perceive control of specific symptoms to be important (e.g., pain, poor sleep, diarrhea). Results were used to inform testing of symptom questionnaires to compare the quality of care provided by six cancer centers.

Abstract

Performance measurement is the process of collecting, analyzing, and reporting standardized measures of clinical performance that can be compared across practices to evaluate how well care was provided. We conducted a systematic review to identify stakeholder perceptions of key symptoms and health domains to test as patient-reported performance measures in oncology. Stakeholders included cancer patients, caregivers, clinicians, and healthcare administrators. Standard review methodology was used, consistent with PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses). MEDLINE/PubMed, EMBASE, and the Cochrane Library were searched to identify relevant studies through August 2020. Four coders independently reviewed entries and conflicts were resolved by a fifth coder. Efficacy and effectiveness studies, and studies focused exclusively on patient experiences of care (e.g., communication skills of providers) were excluded. Searches generated 1813 articles and 1779 were coded as not relevant, leaving 34 international articles for extraction. Patients, caregivers, clinicians, and healthcare administrators prioritize psychosocial care (e.g., distress) and symptom management for patient-reported performance measures. Patients and caregivers also perceive that maintaining physical function and daily activities are critical. Clinicians and administrators perceive control of specific symptoms to be critical (gastrointestinal symptoms, pain, poor sleep). Results were used to inform testing at six US cancer centers.

The Evaluation of Health-Related Quality of Life Issues Experienced by Patients with Desmoid-Type Fibromatosis (The QUALIFIED Study)-A Protocol for an International Cohort Study

Sporadic desmoid-type fibromatosis (DTF) is a rare soft tissue tumour with an unpredictable clinical course. These tumours are incapable of metastasising, but their local aggressive tumour growth and tendency to recur locally can result in a substantial symptom burden. Measuring the impact of DTF on health-related quality of life (HRQoL) can be challenging due to the variable clinical presentation of the disease. Therefore, a HRQoL instrument assessing DTF-specific issues is needed. The QUALIFIED study aims to (1) pre-test a previously developed DTF-specific HRQoL tool (the DTF-QoL); (2) evaluate prevalence of HRQoL issues in adult DTF patients; and (3) identify subgroups at risk of impaired HRQoL. This study (NCT04289077) is an international, multicentre, cross-sectional, observational cohort study. Patients ≥ 18 years with sporadic DTF from the Netherlands and the United Kingdom will be invited to complete a set of questionnaires specifically composed for this patient group. Questionnaires will be completed using PROFILES (Patient Reported Outcomes Following Initial treatment and Long-term Evaluation of Survivorship). Analyses will include testing the psychometric properties of the DTF-QoL and evaluating the prevalence of HRQoL issues using the DTF-QoL, EORTC QOL-C30 and EQ-5D-5L, among other questionnaires. This study will provide insight into HRQoL issues experienced by patients with DTF. Awareness of these issues and the implementation of the DTF-QoL in research and clinical practice can help to improve overall HRQoL and to provide personalised care.

Patient-reported outcome measures (PROMs) use in post-stroke patient care and clinical practice: a realist synthesis protocol

BACKGROUND

There is growing interest in the use of routine patient-reported outcome measures (PROMs) to influence the care of individual patients with stroke. However, there are significant gaps in our understanding as to how PROMs influence post-stroke patient care and clinical practice. This is due to factors including the number of purported uses for PROMs and that PROMs are complex interventions, which attempt to stimulate varied actions or behaviours. Therefore, the objective of this realist synthesis is to offer theory-based explanations as to how PROMs influence post-stroke clinical practice and patient care.

METHODS

This is a protocol for a realist synthesis, which involves three distinct phases: theory building (phase 1), theory testing and refinement (phase 2) and synthesis (phase 3). Phase 1 will develop initial rough programme theories (IRPTs), through literature searches (from January 2000 onwards) of MEDLINE, EMBASE, PsycINFO, CINAHL, Cochrane Library and the grey literature. Only secondary sources will be included that contribute to the development of IRPTs. Only two IRPTs, prioritised by the stakeholder group, will be taken forward to be tested and refined during phase 2. Further novel searches will be employed in phase 2, utilising the same criteria as phase 1; however, phase 2 searches will not utilise grey literature searches, and only primary research studies that contribute to the refinement of programme theories under investigation will be included. Two independent reviewers will screen and select all returned results. The reviewers will code and annotate relevant sources, resulting in 'fragments' to be extracted and graded based on the richness of their contribution to explanation and causal insight. Further, these fragments will be organised into 'Context-Mechanism-Outcome' configurations. Phase 3 of the review will involve the synthesis of context-mechanism-outcome configurations to form middle-range theory-based explanations and developed logic models for stakeholders to understand how PROMs in post-stroke clinical practice and patient care work for whom, how and under what circumstances.

DISCUSSION

The resulting realist synthesis will provide guidance on the implementation of PROMs within routine post-stroke clinical practice and patient care and act as a touchstone for further testing and refinement of PROMs programmes.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42020138649 .

Long-term health-related quality of life and burden of disease after intensive care: development of a patient-reported outcome measure

BACKGROUND

ICU survivorship includes a diverse burden of disease. Current questionnaires used for collecting information about health-related problems and their relation to quality of life lack detailed questions in several areas relevant to ICU survivors. Our aim was to construct a provisional questionnaire on health-related issues based on interviews with ICU survivors and to test if this questionnaire was able to show differences between ICU survivors and a control group.

METHODS

Thirty-two ICU survivors were identified at a post-ICU clinic and interviewed at least six months after ICU discharge. Using an established qualitative methodology from oncology, all dysfunctions and disabilities were extracted, rephrased as questions and compiled into a provisional questionnaire. In a second part, this questionnaire was tested on ICU survivors and controls. Inclusion criteria for the ICU survivors were ICU stay at least 72 h with ICU discharge six months to three years prior to the study. A non-ICU-treated control group was obtained from the Swedish Population Register, matched for age and sex. Eligible participants received an invitation letter and were contacted by phone. If willing to participate, they were sent the questionnaire. Descriptive statistics were applied.

RESULTS

Analysis of the interviews yielded 238 questions in 13 domains: cognition, fatigue, physical health, pain, psychological health, activities of daily living, sleep, appetite and alcohol, sexual health, sensory functions, gastrointestinal functions, urinary functions and work life. In the second part, 395 of 518 ICU survivors and 197 of 231 controls returned a completed questionnaire, the response rates being 76.2% and 85.3%, respectively. The two groups differed significantly in 13 of 22 comorbidities. ICU survivors differed in a majority of questions (p ≤ 0.05) distributed over all 13 domains compared with controls.

CONCLUSIONS

This study describes the development of a provisional questionnaire to identify health-related quality of life issues and long-term burden of disease after intensive care. The questionnaire was answered by 395 ICU survivors. The questionnaire could identify that they experience severe difficulties in a wide range of domains compared with a control group. Trial registry ClinicalTrials.gov Ref# NCT02767180.

Meaningful Clinical Applications of Patient-Reported Outcome Measures in Orthopaedics

»

Patient-reported outcome measures (PROMs) comprise valuable data, when combined with traditional clinical information, for patient-centered health outcome assessment.

»

While PROMs form the foundation of orthopaedic clinical research, they are invaluable tools for clinical care.

»

PROMs play a critical role in shared decision-making with patients, as they are quantitative measures of patient health (function, pain, and satisfaction).

»

PROMs should be incorporated into routine postoperative care for effective clinical monitoring and understanding of the response to surgery.

»

PROMs can be additionally utilized for meaningful clinical research, predictive analytics, and value-based care delivery pathways.

Developing an Implementation Strategy for Systematic Measurement of Patient-Reported Outcomes at an Academic Health Center

EXECUTIVE SUMMARY

Patient-reported outcome measures (PROMs) are used in research and have the potential to improve clinical care. We sought to develop a strategy for integrating PROMs into routine clinical care at an academic health center. The implementation strategy consisted of three phases. The first, exploratory phase, focused on engaging leadership and conducting an inventory of current efforts to collect PROMs. The inventory revealed 87 patient-reported outcome efforts, 47 of which used validated PROMs (62% for research, 21% for clinical care, 17% for quality). In the second, preparatory phase, we identified three pilot implementation sites chosen with facilitators determined in the exploratory phase. Using data from local needs assessments at the pilot sites, we constructed a timeline for inclusion of PROM efforts across the clinical enterprise. In the third phase, we adapted a technology platform for capturing PROMs using the electronic health record and began implementing this platform at the pilot sites. We found that integrating PROMs into routine clinical practice is highly complex. This complexity necessitates change management at the enterprise level.

Identifying and appraising patient-reported outcome measures on treatment satisfaction in acne: a systematic review

BACKGROUND

After dermatitis, acne is the next skin disease to contribute most to the burden of skin diseases worldwide. Recently, seven core outcome domains have been identified, which together form an Acne Core Outcome Set (ACORN). One of these was satisfaction with acne treatment.

OBJECTIVES

To identify studies that described the development of patient-reported outcome measures (PROMS), evaluated one or more measurement properties of a PROM, or evaluated the interpretability of a PROM in patients with acne regarding treatment satisfaction.

METHODS

The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) search strategy for identifying PROMS on acne treatment satisfaction was used. We searched PubMed, MEDLINE, Embase, LILACS, Web of Science, Cochrane Library, Emcare, PsycINFO and Academic Search premier (June 2020). Study selection, data extraction and assessment of methodological quality according to COSMIN guidance were carried out independently by two authors.

RESULTS

Only one study could be included, describing the development of a treatment satisfaction measure in patients with acne. The development was assessed as inadequate and data on measurement properties were lacking. Additionally, we found 188 studies reporting treatment satisfaction solely as an outcome, using a wide variety of methods, none of them standardized or validated.

CONCLUSIONS

We could not find a PROM on treatment satisfaction to recommend for a core outcome set in acne. There is an unmet need for a PROM on treatment satisfaction in acne that is robustly developed, designed and validated.

'We are very individual': anticipated effects on stroke survivors of using their person-generated health data

BACKGROUND

Person-generated health data (PGHD) are produced by people when they use health information technologies. People who use PGHD may experience changes in their health and care process, such as engagement with their own healthcare, and their sense of social support and connectedness. Research into evaluating those reported effects has not kept up; thus, a method for measuring PGHD outcomes was previously designed and applied to the exemplar case of Kinect-based stroke rehabilitation systems. A key step of the method ensures that the patient's voice is included. Allowing stroke survivors to participate in the development and evaluation of health services and treatment can inform healthcare providers on decisions about stroke care, and thereby improve health outcomes.

OBJECTIVE

This paper presents the perspectives of stroke survivors and clinicians on the anticipated effects of stroke survivors' use of PGHD from a poststroke simulated rehabilitation technology.

METHODS

This study gathered the perspectives of stroke survivors and clinicians through three focus groups and three interviews, recruited for convenience. Participants were also asked questions intended to encourage them to comment on the initial items of the patient-reported outcome measure-PGHD. Deductive thematic analysis was performed.

RESULTS

This paper has further demonstrated that outcomes of using PGHD can be measured. For instance, stroke survivors described that using PGHD could result in positive, negative and nil effects on their health behaviours. Survivors and clinicians had varying perspectives in three of the six themes presented, and emphasise the importance of allowing stroke survivors to participate in the evaluation of digital health services.

Selecting Patient-Reported Outcome Measures to Contribute to Primary Care Performance Measurement: a Mixed Methods Approach

New models of primary care include patient-reported outcome measures (PROMs) to promote patient-centered care. PROMs provide information on patient functional status and well-being, can be used to enhance care quality, and are proposed for use in assessing performance. Our objective was to identify a short list of candidate PROMs for use in primary care practice and to serve as a basis for performance measures (PMs). We used qualitative and quantitative methods to identify relevant patient-reported outcome (PRO) domains for use in performance measurement (PRO-PM) and their associated PROMs. We collected data from key informant groups: patients (n = 13; one-on-one and group interviews; concept saturation analysis), clinical thought leaders (n = 9; group discussions; thematic analysis), primary care practices representatives (n = 37; six focus groups; thematic analysis), and primary care payer representatives (n = 10; 12-question survey; frequencies of responses). We merged the key informant group information with findings from environmental literature scans. We conducted a targeted evidence review of measurement properties for candidate PROMs. We used a scoping review and key informant groups to identify PROM evaluation criteria, which were linked to the National Quality Forum measure evaluation criteria. We developed a de novo schema to score candidate PROMs against our criteria. We identified four PRO domains and 10 candidate PROMs: 3 for depressive symptoms, 2 for physical function, 3 for self-efficacy, 2 for ability to participate. Five PROMs met ≥ 70% of the evidence criteria for three PRO domains: PHQ-9 or PROMIS Depression (depression), PF-10 or PROMIS-PF (physical functioning), and PROMIS Self-Efficacy for Managing Treatments and Medications (self-efficacy). The PROMIS Ability to Participate in Social Roles and Activities met 68% of our criteria and might be considered for inclusion. Existing evidence and key informant data identified 5 candidate PROMs to use in primary care. These instruments can be used to develop PRO-PMs.

Cross-cultural adaptation and validation of the Swallowing Disturbance Questionnaire and the Sialorrhea Clinical Scale in Portuguese patients with Parkinson's disease

INTRODUCTION

To date, no valid outcome measure has been developed in European Portuguese (EP) to evaluate the Parkinsons' Disease (PD) patients' (PwP) reports regarding their swallowing disturbances.

OBJECTIVES

The aim of this study was to translate and cross-culturally adapt the Swallowing Disturbance Questionnaire (SDQ) and the Sialorrhea Clinical Scale for PD (SCS-PD) into EP and to determine its clinimetric properties in PwP.

MATERIALS AND METHODS

The original English SDQ and SCS-PD versions were cross-culturally adapted following recommendations established in international guidelines. The validation process involved 75 PwP and 65 healthy sex- and age-matched participants.

RESULTS

The EP versions of the SDQ and SCS-PD are equivalent to the original versions (content, depth, and scoring). Statistical analyses for the SDQ tool revealed good feasibility (missing data <5%), acceptability (no floor or ceiling effects), excellent internal consistency (Cronbach´s α = 0.95), good construct validity (78.5% revealed large to moderate loadings), moderate convergent validity (r = 0.60), good divergent validity (r = 0.40), good known-groups validity (p-value < .05) and a fair sensitivity and specificity (AUC = 0.700). Statistical analyses for the SCS-PD tool shows good feasibility, reasonable acceptability (floor effect), good internal consistency (Cronbach´s α = 0.85), good construct validity (85.7% showed between large to moderate loadings), good convergent validity (r = 0.78), good divergent validity (r = 0.39), good known groups validity (p-value < .05) and a fair sensitivity and specificity (AUC = 0.704).

CONCLUSIONS

The EP versions of the SDQ and SCS-PD maintained the characteristics of the original versions and therefore consistent tools to be used in PwP.

Enabling Better Use of Person-Generated Health Data in Stroke Rehabilitation Systems: Systematic Development of Design Heuristics

BACKGROUND

An established and well-known method for usability assessment of various human-computer interaction technologies is called heuristic evaluation (HE). HE has been adopted for evaluations in a wide variety of specialized contexts and with objectives that go beyond usability. A set of heuristics to evaluate how health information technologies (HITs) incorporate features that enable effective patient use of person-generated health data (PGHD) is needed in an era where there is a growing demand and variety of PGHD-enabled technologies in health care and where a number of remote patient-monitoring technologies do not yet enable patient use of PGHD. Such a set of heuristics would improve the likelihood of positive effects from patients' use of PGHD and lower the risk of negative effects.

OBJECTIVE

This study aims to describe the development of a set of heuristics for the design and evaluation of how well remote patient therapeutic technologies enable patients to use PGHD (PGHD enablement). We used the case of Kinect-based stroke rehabilitation systems (K-SRS) in this study.

METHODS

The development of a set of heuristics to enable better use of PGHD was primarily guided by the R3C methodology. Closer inspection of the methodology reveals that neither its development nor its application to a case study were described in detail. Thus, where relevant, each step was grounded through best practice activities in the literature and by using Nielsen's heuristics as a basis for determining the new set of heuristics. As such, this study builds on the R3C methodology, and the implementation of a mixed process is intended to result in a robust and credible set of heuristics.

RESULTS

A total of 8 new heuristics for PGHD enablement in K-SRS were created. A systematic and detailed process was applied in each step of heuristic development, which bridged the gaps described earlier. It is hoped that this would aid future developers of specialized heuristics, who could apply the detailed process of heuristic development for other domains of technology, and additionally for the case of PGHD enablement for other health conditions. The R3C methodology was also augmented through the use of qualitative studies with target users and domain experts, and it is intended to result in a robust and credible set of heuristics, before validation and refinement.

CONCLUSIONS

This study is the first to develop a new set of specialized heuristics to evaluate how HITs incorporate features that enable effective patient use of PGHD, with K-SRS as a key case study. In addition, it is the first to describe how the identification of initial HIT features and concepts to enable PGHD could lead to the development of a specialized set of heuristics.

Development of a novel patient focussed symptom severity index for use in assessing and treating inflammatory conditions of the lactating breast: a Delphi study

AIM

To investigate the content and face validity of a patient-reported outcome measure used by Australian physiotherapists in the assessment of inflammatory conditions of the lactating breast.

METHODS

Sixty one experts representing 'women who previously had inflammatory conditions of the lactating breast' (48%), 'clinicians' (38%) and 'academics' (8%) interested in women's health and 7% unidentified participants were invited to complete a three round Delphi study.

RESULTS

Ninety five percent of participants agreed that overall, the patient-reported outcome measure was appropriate for use in assessing and treating inflammatory conditions of the lactating breast. The item 'impact' was added to ensure the appropriate assessment of functional aspects of daily life. The item terminology used in the patient-reported outcome measure was simplified to 'pain', 'redness', 'hardness/tightness', 'temperature of affected area', 'sickness/wellness' and 'affected area. A clinician script was developed to ensure the patient-reported outcome measure has utility and consistency regardless of the experience of the women presenting with inflammatory conditions of the lactating breast or the clinician.

CONCLUSION

The resultant Breast Inflammatory Symptom Severity Index (BISSI) is a patient-reported outcome measure for use in the diagnosis and monitoring of clinical changes of symptoms associated with inflammatory conditions of the lactating breast including engorgement, blocked ducts and mastitis. It utilizes person-centred language and assesses symptoms considered important to both patient and clinician. The development of the clinician script facilitates utility regardless of the experience of either the woman with the inflammatory condition or the treating clinician.

Predicting Patient-Centered Outcomes from Spine Surgery Using Risk Assessment Tools: a Systematic Review

PURPOSE OF REVIEW

The purpose of this systematic review is to evaluate the current literature in patients undergoing spine surgery in the cervical, thoracic, and lumbar spine to determine the available risk assessment tools to predict the patient-centered outcomes of pain, disability, physical function, quality of life, psychological disposition, and return to work after surgery.

RECENT FINDINGS

Risk assessment tools can assist surgeons and other healthcare providers in identifying the benefit-risk ratio of surgical candidates. These tools gather demographic, medical history, and other pertinent patient-reported measures to calculate a probability utilizing regression or machine learning statistical foundations. Currently, much is still unknown about the use of these tools to predict quality of life, disability, and other factors following spine surgery. A systematic review was conducted using PRISMA guidelines that identified risk assessment tools that utilized patient-reported outcome measures as part of the calculation. From 8128 identified studies, 13 articles met inclusion criteria and were accepted into this review. The range of c-index values reported in the studies was between 0.63 and 0.84, indicating fair to excellent model performance. Post-surgical patient-reported outcomes were identified in the following categories (n = total number of predictive models): return to work (n = 3), pain (n = 9), physical functioning and disability (n = 5), quality of life (QOL) (n = 6), and psychosocial disposition (n = 2). Our review has synthesized the available evidence on risk assessment tools for predicting patient-centered outcomes in patients undergoing spine surgery and described their findings and clinical utility.

Patient-Reported Outcome Measures of Utilizing Person-Generated Health Data in the Case of Simulated Stroke Rehabilitation: Development Method

BACKGROUND

Person-generated health data (PGHD) are health data that people generate, record, and analyze for themselves. Although the health benefits of PGHD use have been reported, there is no systematic way for patients to measure and report the health effects they experience from using their PGHD. Patient-reported outcome measures (PROMs) allow patients to systematically self-report their outcomes of a health care service. They generate first-hand evidence of the impact of health care services and are able to reflect the real-world diversity of actual patients and management approaches. Therefore, this paper argues that a PROM of utilizing PGHD, or PROM-PGHD, is necessary to help build evidence-based practice in clinical work with PGHD.

OBJECTIVE

This paper aims to describe a method for developing PROMs for people who are using PGHD in conjunction with their clinical care-PROM-PGHD, and the method is illustrated through a case study.

METHODS

The five-step qualitative item review (QIR) method was augmented to guide the development of a PROM-PGHD. However, using QIR as a guide to develop a PROM-PGHD requires additional socio-technical consideration of the PGHD and the health technologies from which they are produced. Therefore, the QIR method is augmented for developing a PROM-PGHD, resulting in the PROM-PGHD development method.

RESULTS

A worked example was used to illustrate how the PROM-PGHD development method may be used systematically to develop PROMs applicable across a range of PGHD technology types used in relation to various health conditions.

CONCLUSIONS

This paper describes and illustrates a method for developing a PROM-PGHD, which may be applied to many different cases of health conditions and technology categories. When applied to other cases of health conditions and technology categories, the method could have broad relevance for evidence-based practice in clinical work with PGHD.

A catalyst for transforming health systems and person-centred care: Canadian national position statement on patient-reported outcomes

Background

Patient-reported outcomes (pros) are essential to capture the patient's perspective and to influence care. Although pros and pro measures are known to have many important benefits, they are not consistently being used and there is there no Canadian pros oversight. The Position Statement presented here is the first step toward supporting the implementation of pros in the Canadian health care setting.

Methods

The Canadian pros National Steering Committee drafted position statements, which were submitted for stakeholder feedback before, during, and after the first National Canadian Patient Reported Outcomes (canpros) scientific conference, 14-15 November 2019 in Calgary, Alberta. In addition to the stakeholder feedback cycle, a patient advocate group submitted a section to capture the patient voice.

Results

The canpros Position Statement is an outcome of the 2019 canpros scientific conference, with an oncology focus. The Position Statement is categorized into 6 sections covering 4 theme areas: Patient and Families, Health Policy, Clinical Implementation, and Research. The patient voice perfectly mirrors the recommendations that the experts reached by consensus and provides an overriding impetus for the use of pros in health care.

Conclusions

Although our vision of pros transforming the health care system to be more patient-centred is still aspirational, the Position Statement presented here takes a first step toward providing recommendations in key areas to align Canadian efforts. The Position Statement is directed toward a health policy audience; future iterations will target other audiences, including researchers, clinicians, and patients. Our intent is that future versions will broaden the focus to include chronic diseases beyond cancer.

Do Medicare's Patient-Reported Outcome Measures Collection Windows Accurately Reflect Academic Clinical Practice?

BACKGROUND

The Comprehensive Care for Joint Replacement (CJR) mandates collection of patient-reported outcome measures (PROMs) for eligible total hip and total knee arthroplasty (THA and TKA) procedures during specific time periods that may not be attainable within routine academic practice.

METHODS

We performed a retrospective analysis of prospectively collected PROM data from a 2017 cohort of primary THA and TKA patients who completed the Patient-Reported Outcomes Measurement Information System-10 global health survey in preoperative or postoperative time periods. The primary outcome was completion rates of Patient-Reported Outcomes Measurement Information System-10 per the CJR collection periods (90-0 days preoperative and 270-365 days postoperative) compared to an extended postoperative collection period of 270-396 days. Bivariate analysis and logistic regression were used to analyze the association between survey completion rates and patient characteristics.

RESULTS

Of the 860 primary THAs and TKAs in 2017, 725 (84.3%) had preoperative surveys completed 90-0 days before surgery. Among the 725 patients, 215 (29.7%) completed postoperative surveys within the CJR timeline of 270-365 days. Completion increased by 120 additional surveys (+16.5%) in the additional postoperative time period of 270-396 days (P < .001). No patient or procedural factors significantly correlated with a higher likelihood of postoperative PROM completion (P > .05 for all covariates).

CONCLUSION

In an academic clinical practice, completion rates of postoperative PROMs as part of routine clinical practice within the CJR mandated period was low for THA and TKA patients. CJR may consider additional time beyond 365 days to improve PROM completion rates.

Performance Measures Based on How Adults With Cancer Feel and Function: Stakeholder Recommendations and Feasibility Testing in Six Cancer Centers

PURPOSE

Patient-reported outcome measures (PROMs) that assess how patients feel and function have potential for evaluating quality of care. Stakeholder recommendations for PRO-based performance measures (PMs) were elicited, and feasibility testing was conducted at six cancer centers.

METHODS

Interviews were conducted with 124 stakeholders to determine priority symptoms and risk adjustment variables for PRO-PMs and perceived acceptability. Stakeholders included patients and advocates, caregivers, clinicians, administrators, and thought leaders. Feasibility testing was conducted in six cancer centers. Patients completed PROMs at home 5-15 days into a chemotherapy cycle. Feasibility was operationalized as ≥ 75% completed PROMs and ≥ 75% patient acceptability.

RESULTS

Stakeholder priority PRO-PMs for systemic therapy were GI symptoms (diarrhea, constipation, nausea, vomiting), depression/anxiety, pain, insomnia, fatigue, dyspnea, physical function, and neuropathy. Recommended risk adjusters included demographics, insurance type, cancer type, comorbidities, emetic risk, and difficulty paying bills. In feasibility testing, 653 patients enrolled (approximately 110 per site), and 607 (93%) completed PROMs, which indicated high feasibility for home collection. The majority of patients (470 of 607; 77%) completed PROMs without a reminder call, and 137 (23%) of 607 completed them after a reminder call. Most patients (72%) completed PROMs through web, 17% paper, or 2% interactive voice response (automated call that verbally asked patient questions). For acceptability, > 95% of patients found PROM items to be easy to understand and complete.

CONCLUSION

Clinicians, patients, and other stakeholders agree that PMs that are based on how patients feel and function would be an important addition to quality measurement. This study also shows that PRO-PMs can be feasibly captured at home during systemic therapy and are acceptable to patients. PRO-PMs may add value to the portfolio of PMs as oncology transitions from fee-for-service payment models to performance-based care that emphasizes outcome measures.