Patient-reported outcome measures in core outcome sets targeted overlapping domains but through different instruments

Electronic symptom monitoring for home-based palliative care: A systematic review

BACKGROUND

Coordination and communication challenges in home-based palliative care complicate transitions from hospital care. Electronic symptom monitoring enables real-time data collection, enhancing patient-provider communication. However, a systematic evaluation of its effectiveness in home-based palliative care is lacking.

AIM

To analyze the feasibility, effectiveness, and limitations of electronic symptom monitoring in home-based palliative care, assess the evidence quality, identify the evidence gap, and suggest implications for future research and practice.

DESIGN

This study uses systematic review, meta-analysis, and narrative synthesis (CRD42023457977) to analyze relevant studies until September 2023.

DATA SOURCES

Electronic searches in MEDLINE, CENTRAL, and Embase until September 2023, complemented by hand-searching of references and citations.

RESULTS

This study included twenty studies. The majority of patients positively engage in electronic symptom monitoring, which could improve their quality of life, physical and emotional well-being, and symptom scores without a significant increase in costs. However, firm conclusions about the effects of electronic symptom monitoring on outcomes like survival, hospital admissions, length of stay, emergency visits, and adverse events were limited due to significant variability in the reported data or inadequate statistical power.

CONCLUSION

Introducing electronic symptom monitoring in home-based palliative care holds potential for enhancing patient-reported outcomes, potentially decreasing hospital visits and costs. However, inconsistency in current studies arising from diverse monitoring systems obstructs comparability. To advance, future high-quality research should employ standardized follow-up periods and established scales to better grasp the benefits of electronic symptom monitoring in home-based palliative care.

Country-specific reference values for PROMIS® pain, physical function and participation measures compared to US reference values

INTRODUCTION

Patient-Reported Outcomes Measurement Information System (PROMIS^®) is commonly used across medical conditions. To facilitate interpretation of scores across countries, we calculated Dutch reference values for PROMIS Physical Function (PROMIS-PF), Pain Interference (PROMIS-PI), Pain Behavior (PROMIS-PB), Ability to Participate in Social Roles and Activities (PROMIS-APSRA), and Satisfaction with Social Roles and Activities (PROMIS-SSRA), as compared to US reference values.

PATIENTS AND METHODS

A panel completed full PROMIS-PF (n=1310), PROMIS-PI and PROMIS-PB (n=1052), and PROMIS-APSRA and PROMIS-SSRA (n=1002) item banks and reported their level of health per domain (no, mild, moderate, severe limitations). T-scores were calculated by sample and subgroups (age, gender, self-reported level of domain). Distribution-based and anchor-based thresholds for mild, moderate, and severe scores were determined.

RESULTS

Mean T-scores were close to the US mean of 50 for PROMIS-PF (49.8) and PROMIS-APSRA (50.6), lower for PROMIS-SSRA (47.5) and higher for PROMIS-PI (54.9) and PROMIS-PB (52.0). Distribution-based thresholds for mild, moderate, and severe scores were comparable to US recommended cut-off values (except for PROMIS-PI) but participants reported limitations 'earlier' than suggested thresholds.

CONCLUSION

Dutch reference values were close to US reference values for some PROMIS domains but not all. We recommend country-specific reference values to facilitate worldwide PROMIS use.KEY MESSAGESPROMIS offers universally applicable IRT-based efficient and patient-friendly measures to assess commonly relevant patient-reported outcomes across medical conditions.To support the use of PROMIS in daily clinical practice and research across the world, country-specific general population reference values should be obtained.More research is necessary to obtain reliable and valid cut-off values for what constitutes mild, moderate and severe scores from the patients' perspective.

Patient-reported outcome measures in drugs for neurological conditions approved by European Medicines Agency 2017-2022

BACKGROUND

Regulatory agencies have been responsive to public demand for inclusion of the patient experience in evaluating and approving therapies. Over the years, patient-reported outcome measures (PROMs) have become increasingly prevalent in clinical trial protocols; however, their influence on regulators, payers, clinicians, and patients' decision-making is not always clear. We recently conducted a cross-sectional study aimed at investigating the use of PROMs in new regulatory approvals of drugs for neurological conditions between 2017 and 2022 in Europe.

METHODS

We reviewed European Public Assessment Reports (EPARs) and recorded on a predefined data extraction form whether they considered PROMs, their characteristics (e.g., primary/secondary endpoint, generic/specific instrument) and other relevant information (e.g., therapeutic area, generic/biosimilar, orphan status). Results were tabulated and summarized by means of descriptive statistics.

RESULTS

Of the 500 EPARs related to authorized medicines between January 2017 and December 2022, 42 (8%) concerned neurological indications. Among the EPARs of these products, 24 (57%) reported any use of PROMs, typically considered as secondary (38%) endpoints. In total, 100 PROMs were identified, of which the most common were the EQ-5D (9%), the SF-36 (6%), or its shorter adaptation SF-12, the PedsQL (4%).

CONCLUSIONS

Compared to other disease areas, neurology is one where the use of patient-reported outcomes evidence is inherently part of the clinical evaluation and for which core outcome sets exist. Better harmonization of the instruments recommended for use would facilitate the consideration of PROMs at all stages in the drug development process.

Patient-Reported Outcome Measures in Key Sub-Saharan African Languages to Promote Diversity: A Scoping Review

OBJECTIVES

Sub-Saharan Africa is a world region rich and diverse in cultures and languages; yet, it is also challenged with regard to resources that may facilitate the cultural adaptation or development of patient-reported outcome measures (PROMs). Systematic exclusion of patients' "voices," because of gaps in the availability of PROMs, may perpetuate health inequity. Hence, the objective is to describe the availability of PROMs in the non-English, sub-Saharan African languages.

METHODS

A scoping review was conducted to identify PROMs that had been translated, validated, or developed for use in 32 selected, non-English, sub-Saharan African languages pertaining to health outcomes. Four databases were searched (May 7, 2021), and additional articles were identified through reference screening and via corresponding authors. Data were extracted in terms of country, language, population, construct, and PROM characteristics (eg, number of items).

RESULTS

A total of 220 unique articles were included from 7451 records, leading to the identification of 126 unique PROMs. Most studies were conducted in either Ethiopia, Nigeria, or South Africa. As such, prevalent languages included Amharic, Yoruba, and non-English languages common to South Africa (eg, Setswana, Xhosa, and Zulu). No PROMs were identified in any of the languages for 27 sub-Saharan African countries or 10 of the 32 included languages.

CONCLUSIONS

There are significant gaps in the availability of PROMs across the non-English African languages included. Nevertheless, the PROMs that were identified largely align with core outcome sets relevant to the prevalent disease burden in this world region. Consensus-based priority setting may inform the most pertinent gaps to be addressed.

Development of a standard set of PROs and generic PROMs for Dutch medical specialist care : Recommendations from the Outcome-Based Healthcare Program Working Group Generic PROMs

PURPOSE

The added value of measuring patient-reported outcomes (PROs) for delivering patient-centered care and assessment of healthcare quality is increasingly evident. However, healthcare system wide data collection initiatives are hampered by the proliferation of patient-reported outcome measures (PROMs) and conflicting data collection standards. As part of a national initiative of the Dutch Ministry of Health, Welfare and Sport we developed a consensus-based standard set of generic PROs and PROMs to be implemented across Dutch medical specialist care.

METHODS

A working group of mandated representatives of umbrella organizations involved in Dutch medical specialist care, together with PROM experts and patient organizations worked through a structured, consensus-driven co-creation process. This included literature reviews, online expert and working group meetings, and feedback from national patient- and umbrella organizations. The 'PROM-cycle' methodology was used to select feasible, valid, and reliable PROMs to obtain domain scores for each of the PROs included in the set.

RESULTS

Eight PROs across different domains of health were ultimately endorsed: symptoms (pain & fatigue), functioning (physical, social/participation, mental [anxiety & depression]), and overarching (quality of life & perceived overall health). A limited number of generic PROMs was endorsed. PROMIS short forms were selected as the preferred instruments for all PROs. Several recommendations were formulated to facilitate healthcare system level adoption and implementation of the standard set.

CONCLUSIONS

We developed a consensus-based standard set of Generic PROMs and a set of recommendations to facilitate healthcare system wide implementation across Dutch medical specialist care.

Clinical Properties of the 6-Clicks and Functional Status Score for the ICU in a Hospital in the United Arab Emirates

OBJECTIVE

To determine measurement properties of the Activity Measure for Post-Acute Care Inpatient Mobility Short Form (6-clicks) and Functional Status Score for the Intensive Care Unit (FSS-ICU).

DESIGN

Retrospective analysis of scores from a cohort of patients over 24 months. Outcome measures were administered to patients referred to physical therapy on admission and discharge.

SETTING

Tertiary care hospital in the United Arab Emirates.

PARTICIPANTS

2793 adults referred to physical therapy; 62% were male, with a median age of 58 (interquartile range=44-70) and the median length of stay was 14 days (interquartile range=8-28).

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURE

Instruments' clinical measurement properties: (1) responsiveness as per mean change and effect size; (2) floor and ceiling effects; and (3) minimal important difference. Results were analyzed for the whole group as well as 3 subgroups: patients with stroke as primary diagnosis (n = 644), discharged from heart and vascular floors (n = 642), and discharged from medical floors (n = 554).

RESULTS

The mean change and effect size (Cohen's d) for the 6-clicks were +8.3 (±8.6) and 0.97, and for the FSS-ICU they were +6.8 (±7.8) and 0.87, respectively. 6-Clicks had a floor effect on admission among patients with stroke (16.9%) and patients discharged from medical floors (19.3%), as well as a ceiling effect on discharge (25.5% in the whole group). The FSS-ICU had a ceiling effect on discharge (23.2% in whole group). The estimated minimal important difference for the 6-clicks was 4.3, and for the FSS-ICU it was 3.9.

CONCLUSION

Both instruments demonstrate good responsiveness in adults hospitalized in the United Arab Emirates. The FSS-ICU exhibited several advantages in performance that suggest greater clinical utility than the 6-clicks. Minimal important differences were generated, which has not been previously reported for the 6-clicks.

Common Patient-Reported Outcomes Within the Food and Drug Administration Voice of the Patient Reports

OBJECTIVES

Proponents of disease-specific patient-reported outcome measurements (PROMs) often argue disease-agnostic measures do not adequately capture their patient population's experience. Patient-Reported Outcomes Measurement Information System (PROMIS) provides a disease-agnostic domain set that may adequately cover many diseases. This study seeks to investigate whether PROMIS's quality of life domain coverage can span patient-reported outcomes (PROs) elicited from patients across unrelated diseases.

METHODS

The Food and Drug Administration Voice of the Patient reports were an initiative to elevate patient voices regarding their condition and associated treatments. Two reviewers extracted patient-reported health-related (quality of life) domains from the reports and categorized them into PROMIS domains or non-PROMIS domains. Domain coverage was summarized for each report. Any extracted PROs not covered by PROMIS domains were placed in an "other" category and analyzed for common themes.

RESULTS

Across 26 reports, PROMIS covered 216 of 374 (70%) of the reports' PRO domains. The heritable bleeding disorders report had the highest coverage (82%). Human immunodeficiency virus had the lowest coverage (50%). The most common PROMIS domain, "ability to participate in social roles," appeared in 25 reports (96%). The most common domains not included in PROMIS were stigma, sensitivities, and sensory deficits as evident in 19 (73%), 18 (69%), and 18 reports (69%), respectively. If the top 3 unincluded domains were amended into PROMIS, the total domain coverage would increase to 84%.

CONCLUSIONS

PRO domains elicited in the Food and Drug Administration Voice of the Patient reports were widely captured by PROMIS, suggesting domains patients experience contain enough overlap to be recorded by appropriate PROMIS domains. PROMIS could increase its coverage by adding domains.

Linking Hip Disability and Osteoarthritis Outcome Score-Physical Function Short Form and PROMIS Physical Function

INTRODUCTION

Linking scores on patient-reported outcome measures can enable data aggregation for research, clinical care, and quality. We aimed to link scores on the Hip Disability and Osteoarthritis Outcome Score-Physical Function Short Form (HOOS-PS) and the Patient-reported Outcomes Measurement Information System Physical Function (PROMIS PF).

METHODS

A retrospective study was conducted from 2017 to 2020 evaluating patients with hip osteoarthritis who received routine clinical care from an orthopaedic surgeon. Our sample included 3,382 unique patients with 7,369 pairs of HOOS-PS and PROMIS PF measures completed at a single nonsurgical, preoperative, or postoperative time point. We included one randomly selected time point of scores for each patient in our linking analysis sample. We compared the accuracy of linking using four methods, including equipercentile and item response theory-based approaches.

RESULTS

PROMIS PF and HOOS-PS scores were strongly correlated ( r = -0.827 for raw HOOS-PS scores and r = 0.820 for summary HOOS-PS scores). The assumptions were met for equipercentile and item response theory approaches to linking. We selected the item response theory-based Stocking-Lord approach as the optimal crosswalk and estimated item parameters for the HOOS-PS items on the PROMIS metric. A sensitivity analysis demonstrated overall robustness of the crosswalk estimates in nonsurgical, preoperative, and postoperative patients.

CONCLUSION

These crosswalks can be used to convert scores between HOOS-PS and PROMIS PF metric at the group level, which can be valuable for data aggregation. Conversion of individual patient-level data is not recommended secondary to increased risk of error.

Quality of patient-reported outcome reporting in trials of diabetes in pregnancy: A systematic review

AIMS

Patient-reported outcomes (PROs) are reports of the patient's health status that come directly from the patient without interpretation by the clinician or anyone else. They are increasingly used in randomised controlled trials (RCTs). In this systematic review we identified RCTs conducted in women with diabetes in pregnancy which included PROs in their primary or secondary outcomes. We then evaluated the quality of PRO reporting against an internationally accepted reporting framework (Consolidated Standards of Reporting Trials (CONSORT-PRO) guidelines).

METHODS

We searched online databases for studies published 2013-2021 using a combination of keywords. Two authors reviewed all abstracts independently. Data on study characteristics and the quality of PRO reporting were extracted from relevant studies. We conducted a multiple regression analysis to identify factors associated with high quality reporting.

RESULTS

We identified 7122 citations. Thirty-five articles were included for review. Only 17% of RCTs included a PRO as a primary or secondary outcome. Out of a maximum score of 100 the median score was 46, indicating sub-optimal reporting. A multiple regression analysis did not reveal any factors associated with high quality reporting.

CONCLUSIONS

Researchers should be mindful of the importance of PRO inclusion and reporting and include reliable PROs in trials.

The patient-reported outcomes measurement information systems (PROMIS®) physical function and its derivative measures in adults: a systematic review of content validity

PURPOSE

This study aims to systematically review and critically appraise the content validity of the adult versions of the Patient-Reported Outcomes Measurement Information System Physical Function (PROMIS-PF) item bank and its derivative measures in any adult population.

METHODS

MEDLINE and EMBASE were searched in October 2021 for studies on measurement properties of PROMIS-PF measures in an adult population. Studies were included if the study described the development of a PROMIS-PF measure or investigated its relevance, comprehensiveness, or comprehensibility. Assessment of the methodological quality of eligible studies, rating of results, and summarizing evidence was performed following the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) methodology for assessing content validity. A modified GRADE approach was used to determine the level of evidence.

RESULTS

Three development studies and eight studies on the content validity of one or more of the PROMIS-PF measures were identified. The methodological quality of most studies was rated doubtful. There was low to high level evidence for sufficient relevance, comprehensiveness, and comprehensibility of most PROMIS-PF measures for healthy seniors and various disease populations. We found low to moderate level evidence for insufficient relevance of PROMIS-PF measures for patients with conditions that affected only one body part, and insufficient comprehensibility of the PROMIS-PF measures for minority elderly.

CONCLUSION

Most PROMIS-PF measures demonstrate sufficient content validity in healthy seniors and various disease populations. However, the quality of this evidence is generally low to moderate, due to limitations in the methodological quality of the studies.

Patients' perspective on supposedly patient-relevant process and outcome parameters: a cross-sectional survey within the 'PRO patients study'

BACKGROUND

To be able to make informed choices based on their individual preferences, patients need to be adequately informed about treatment options and their potential outcomes. This implies that studies measure the effects of care based on parameters that are relevant to patients. In a previous scoping review, we found a wide variety of supposedly patient-relevant parameters that equally addressed processes and outcomes of care. We were unable to identify a consistent understanding of patient relevance and therefore aimed to develop an empirically based concept including a generic set of patient-relevant parameters. As a first step we evaluated the process and outcome parameters identified in the scoping review from the patients' perspective.

METHODS

We conducted a cross-sectional survey among German general practice patients. Ten research practices of Witten/Herdecke University supported the study. During a two-week period in the fall of 2020, patients willing to participate self-administered a short questionnaire. It evaluated the relevance of the 32 parameters identified in the scoping review on a 5-point Likert scale and offered a free-text field for additional parameters. These free-text answers were inductively categorized by two researchers. Quantitative data were analyzed using descriptive statistics. Bivariate analyses were performed to determine whether there are any correlations between rating a parameter as highly relevant and patients' characteristics.

RESULTS

Data from 299 patients were eligible for analysis. All outcomes except 'sexuality' and 'frequency of healthcare service utilization' were rated important. 'Confidence in therapy' was rated most important, followed by 'prevention of comorbidity' and 'mobility'. Relevance ratings of five parameters were associated with patients' age and gender, but not with their chronic status. The free-text analysis revealed 15 additional parameters, 12 of which addressed processes of care, i.e., 'enough time in physician consultation'.

CONCLUSION

Patients attach great value to parameters addressing processes of care. It appears as though the way in which patients experience the care process is not less relevant than what comes of it. Relevance ratings were not associated with chronic status, but few parameters were gender- and age-related.

TRIAL REGISTRATION

Core Outcome Measures in Effectiveness Trials Initiative, registration number: 1685.

Goal-based outcomes of hospitalisation of older adults are predicted by gender, confidence, quality of life and type of goals

PURPOSE

Although patient-reported outcome measures (PROMs) might reflect relevant outcomes from patient perspective, they do not always reflect what the individual patient finds important. Our objectives were to assess which PROM was best suited to evaluate patient-relevant outcomes of hospitalisation and to assess which factors predicted this PROM.

METHODS

A longitudinal study was conducted among hospitalised older patients. Three PROMs were compared with the anchor question 'How much have you benefited from the admission?': a general quality of life measure: EQ-5D; a measure of daily functioning: Katz-15 and a goal-based measure: achievement of self-defined goals. Predictors were examined using logistic regression analyses.

RESULTS

We had 185 cases with baseline and follow-up. Accomplishment of self-defined goals showed a large correlation with the anchor question, whereas EQ-5D and Katz-15 showed no significant correlations. The final regression model had four predictors: being man, having higher confidence in goal achievement and good/excellent quality of life increased the odds for goal accomplishment, while having goals in the category alleviating complaints reduced the odds.

CONCLUSION

Accomplishment of individual goals represented the benefit experienced by participants best. Subjective indicators of health and functioning are better predictors of goal accomplishment than objective ones. According to participant experience, the hospital appeared successful in managing disease-specific problems, but less successful in ameliorating complaints. Medical decision-making should not only be based on medical indicators, but the input of the patient is at least as important. Quality of life, goals and confidence should be discussed. More attention is needed for symptom experience.

Mixed-methods approach to develop an agreed concept on patient relevance: study protocol for the 'PRO patients study'

INTRODUCTION

With respect to patient-centred care and shared decision-making, measuring care effects based on outcomes relevant to patients is becoming increasingly important. Recently, a scoping review of the international literature revealed a wide range of supposedly patient-relevant outcomes and found that there is neither a sound definition of patient relevance nor a consistent set of outcomes relevant to patients. To close this gap, this study aims to develop an agreed concept on patient relevance including a set of outcomes relevant to patients irrespective of diseases, which grades outcomes according to their importance.

METHODS AND ANALYSIS

This prospective mixed-methods study will integrate the perspectives of patients across diseases, healthcare professionals and researchers. The consensus process will consist of four phases. Based on the results of the recent scoping review, a patient survey will be conducted first, followed by a multiprofessional group discussion. Finally, a two-round online Delphi approach based on data from the previous phases will be applied to agree on a concept.

ETHICS AND DISSEMINATION

Ethics approval for the study was granted on 26 August 2020 by the Ethics Commission of Witten/Herdecke University (reference number: 156/2020). In the long run, the implementation of an agreed concept on patient relevance will help improve the comparability of study results regarding the patient benefit and thereby strengthen the role of patients in the decision-making process. Also, the experiences regarding grading outcomes according to importance will help to develop a method on how to individualise clinical trial outcomes according to each patient's individual specifics and priorities in order to more adequately represent the patient perspective in clinical research.

TRIAL REGISTRATION NUMBER

Core Outcome Measures in Effectiveness Trials Initiative (registration number: 1685).