The French PROMIS-29. Psychometric validation and population reference values

Equating and linking Patient-Reported Outcomes Measurement Information System 29-item questionnaire and 36-item Short-Form Health Survey domains using Rasch modeling

OBJECTIVES

To develop a simple, practical methodology to equate or link equivalent domains of the 36-item Short-Form Health Survey (SF-36) and the Patient-Reported Outcomes Measurement Information System 29-item questionnaire (PROMIS-29) using the Rasch framework.

STUDY DESIGN AND SETTING

In April 2016, the PROMIS-29 and SF-36 were completed by 1501 individuals selected to be representative of the French population. For each domain common to the two questionnaires, a Partial Credit Model was fitted to the items related to that dimension in the two questionnaires. These items were then calibrated on the same metric, which enabled the scores from one questionnaire to be associated with the scores from the other.

RESULTS

Six of the seven PROMIS-29 scales and five of the six SF-36 subscales (physical, pain, social, vitality, depression and anxiety domains) were equated or linked. Correspondence tables between scores, with a 95% confidence interval, were established for each domain. A freely available Stata macro program was developed to automatize the equating or linking process.

CONCLUSION

These results should facilitate comparisons across studies using the SF-36 and the PROMIS-29 in France. The equating or linking process developed is simple to implement and can be used in other countries and for other instruments.

Patient-reported outcomes for people with diabetes: what and how to measure? A narrative review

Patient-reported outcomes (PROs) are valuable for shared decision making and research. Patient-reported outcome measures (PROMs) are questionnaires used to measure PROs, such as health-related quality of life (HRQL). Although core outcome sets for trials and clinical practice have been developed separately, they, as well as other initiatives, recommend different PROs and PROMs. In research and clinical practice, different PROMs are used (some generic, some disease-specific), which measure many different things. This is a threat to the validity of research and clinical findings in the field of diabetes. In this narrative review, we aim to provide recommendations for the selection of relevant PROs and psychometrically sound PROMs for people with diabetes for use in clinical practice and research. Based on a general conceptual framework of PROs, we suggest that relevant PROs to measure in people with diabetes are: disease-specific symptoms (e.g. worries about hypoglycaemia and diabetes distress), general symptoms (e.g. fatigue and depression), functional status, general health perceptions and overall quality of life. Generic PROMs such as the 36-Item Short Form Health Survey (SF-36), WHO Disability Assessment Schedule (WHODAS 2.0), or Patient-Reported Outcomes Measurement Information System (PROMIS) measures could be considered to measure commonly relevant PROs, supplemented with disease-specific PROMs where needed. However, none of the existing diabetes-specific PROM scales has been sufficiently validated, although the Diabetes Symptom Self-Care Inventory (DSSCI) for measuring diabetes-specific symptoms and the Diabetes Distress Scale (DDS) and Problem Areas in Diabetes (PAID) for measuring distress showed sufficient content validity. Standardisation and use of relevant PROs and psychometrically sound PROMs can help inform people with diabetes about the expected course of disease and treatment, for shared decision making, to monitor outcomes and to improve healthcare. We recommend further validation studies of diabetes-specific PROMs that have sufficient content validity for measuring disease-specific symptoms and consider generic item banks developed based on item response theory for measuring commonly relevant PROs.

Perceived self-efficacy and empowerment in patients at increased risk of sudden cardiac arrest

Background

The role of multidisciplinary clinics for psychosocial care is increasingly recognized for those living with inherited cardiac conditions (ICC). In Canada, access to healthcare providers differ between clinics. Little is known about the relationship between access to specialty care and a patient's ability to cope with, and manage their condition.

Methods

We leveraged the Hearts in Rhythm Organization (HiRO) to conduct a cross-sectional, community-based survey of individuals with ICC and their family members. We aimed to describe access to services, and explore the relationships between participants' characteristics, cardiac history and self-reported health status and self-efficacy (GSE: General Self-Efficacy Scale) and empowerment (GCOS-24: Genetic Counseling Outcome Scale).

Results

We collected 235 responses from Canadian participants in 10 provinces and territories. Overall, 63% of participants reported involvement of a genetic counsellor in their care. Access to genetic testing was associated with greater empowerment [mean GCOS-24: 121.14 (SD = 20.53) vs. 105.68 (SD = 21.69); p = 0.004]. Uncertain genetic test results were associated with lower perceived self-efficacy (mean GSE: uncertain = 28.85 vs. positive = 33.16, negative = 34.13; p = 0.01). Low global mental health scores correlated with both lower perceived self-efficacy and empowerment scores, with only 11% of affected participants reporting involvement of psychology services in their care.

Conclusion

Differences in resource accessibility, clinical history and self-reported health status impact the perceived self-efficacy and empowerment of patients with ICC. Future research evaluating interventions to improve patient outcomes is recommended.

Translation, cross-cultural adaptation and validation of the Persian version of selected PROMIS measures for use in lumbar canal stenosis patients

BACKGROUND

The National Institutes of Health (NIH) developed a new measurement system called the Patient-Reported Outcomes Measurement Information System (PROMIS) which can be used for multiple health conditions. The 29-item short form (PROMIS-29) with seven domains was more often used by clinical researchers to measure the physical function, mood and sleeping status of patients with low back pain (LBP). Translation of the PROMIS into multiple languages and adaptation of its application in different cultural diversities can help to further standardize clinical research studies and make them comparable to each other. This study aimed to cross-culturally adapt the PROMIS-29 into Persian (P-PROMIS-29) and evaluate the construct validity and reliability of the translated questionnaire among patients with lumbar canal stenosis.

MATERIALS AND METHODS

The translation was conducted by using the multilingual translation methodology guideline. Construct validity, internal consistency, and test-retest reliability at a two-week interval for the P-PROMIS-29 were calculated. Construct validity was assessed by calculating correlations between the P-PROMIS-29 with Oswestry Disability Index (ODI) and Roland-Morris results.

RESULTS

The study sample included 70 participants with lumbar canal stenosis. Internal consistencies were moderate to good with Cronbach's alpha ranging from 0.2 to 0.94. The test-retest reliability evaluation was excellent with intraclass correlation coefficients (ICCs) ranging from 0.885 to 0.986. Construct validity of different domains of P-PROMIS-29 were moderate to good, with Pearson's correlation coefficient results ranging from 0.223 to 0.749.

CONCLUSION

Our results showed that P-PROMIS-29 is a valid and reliable measurement tool for evaluation of patients with lumbar canal stenosis.

Hungarian PROMIS-29+2: psychometric properties and population reference values

OBJECTIVES

This study aims to assess psychometric properties of the Hungarian PROMIS-29+2 profile measure and provide general population reference values for Hungary.

METHODS

An adult general population sample (n = 1700) completed PROMIS-29+2 v2.1 in an online survey. The following psychometric properties were assessed: floor and ceiling effect, convergent validity with SF-36v1 domains, internal consistency (McDonald's omega), unidimensionality, local independence, monotonicity, graded response model (GRM) fit and differential item functioning (DIF). Age- and gender-specific reference values were established using the US item calibrations.

RESULTS

Depending on scale orientation, high floor or ceiling effects were observed for all domains (25.2-60.7%) except for sleep disturbance. McDonald's omega for domains ranged from 0.87-0.97. Unidimensionality, local independence and monotonicity were supported and the GRM adequately fitted for all but one domains. The sleep disturbance domain demonstrated item misfit, response level disordering and low discrimination ability, particularly for item Sleep116 ('refreshing sleep'). Strong correlations were observed between PROMIS-29+2 and corresponding SF-36 domains (r_s=│0.60│ to │0.78│). No DIF was detected for most sociodemographic characteristics. Problems with physical function, pain interference and social roles tended to increase, whereas problems with anxiety, depression, fatigue and cognitive function declined with age (p < 0.01). In all domains except for cognitive function, more health problems occurred in females than in males (p < 0.001).

CONCLUSION

The Hungarian PROMIS-29+2 shows satisfactory psychometric properties; however, the sleep disturbance domain substantially underperforms that requires further attention. Population reference values were generated that facilitate the interpretation of health outcomes in various patient populations.

Mapping the Patient-Reported Outcomes Measurement Information System (PROMIS-29) to EQ-5D-5L

BACKGROUND AND OBJECTIVE

The Patient-Reported Outcomes Measurement Information System (PROMIS-29) is gaining popularity as healthcare system funders increasingly seek value-based care. However, it is limited in its ability to estimate utilities and thus inform economic evaluations. This study develops the first mapping algorithm for estimating EuroQol 5-Dimension 5-Level (EQ-5D-5L) utilities from PROMIS-29 responses using a large dataset and through extensive comparisons between econometric models.

METHODS

An online survey was conducted to collect responses to PROMIS-29 and EQ-5D-5L from the general Australian population (N = 3013). Direct and indirect mapping methods were explored, including linear regression, Tobit, generalised linear model, censored regression model, beta regression (Betamix), the adjusted limited dependent variable mixture model (ALDVMM) and generalised ordered logit. The most robust model was selected by assessing the performance based on average ten-fold cross-validation geometric mean absolute error and geometric mean squared error, the predicted mean, maximum and minimum utilities, as well as the fitting across the entire distribution.

RESULTS

The direct approach using ALDVMM was considered the preferred model based on lowest geometric mean absolute error and geometric mean squared error in cross-validation (0.0882, 0.0299) and its superiority in predicting the actual observed mean, full health states and lower utility extremes. The robustness and precision in prediction across the entire distribution of utilities with ALDVMM suggest it is an accurate and valid mapping algorithm. Moreover, the suggested mapping algorithm outperformed previously published algorithms using Australian data, indicating the validity of this model for economic evaluations.

CONCLUSIONS

This study developed a robust algorithm to estimate EQ-5D-5L utilities from PROMIS-29. Consistent with the recent literature, the ALDVMM outperformed all other econometric models considered in this study, suggesting that the mixture models have relatively better performance and are an ideal candidate model for mapping.

Preliminary evaluation of the Chinese version of the patient-reported outcomes measurement information system 29-item profile in patients with aortic dissection

BACKGROUND

The Patient-Reported Outcomes Measurement Information System 29-item Profile (PROMIS-29) has been widely used to measure health outcomes from the patient's perspective. It has not been validated in adults with aortic disease. The aim of this study was to explore the reliability and validity of the Chinese PROMIS-29 among patients undergoing surgery for aortic dissection (AD).

METHODS

A cross-sectional design was applied. Eligible patients completed a questionnaire that contained the PROMIS-29 and legacy measures, including the Short Form-12 Health Survey (SF-12), 8-item Somatic Symptom Scale (SSS-8), Generalized Anxiety Disorder-2 (GAD-2), and Patient Health Questionnaire-2 (PHQ-2). The structural validity of the PROMIS-29 was evaluated using confirmatory factor analysis (CFA). Reliability was evaluated with Cronbach's α. Construct validity was assessed by calculating Spearman's rank correlations and comparing known-group differences.

RESULTS

In total, a sample of 327 AD patients was included in the final analysis. Most of them were male (89%) with a mean age of 52.7 (± 10.3). CFA revealed good model fit of the seven-factor structure within PROMIS-29, as well as most domains in single-factor analysis. Reliability was confirmed with Cronbach's α > 0.90. Correlations between comparable domains of the PROMIS-29 and those of legacy questionnaires and most know-group comparisons were observed as hypothesized.

CONCLUSIONS

This study found evidence for acceptable structural validity, construct validity and internal consistency of the PROMIS-29 in a sample of AD patients. It can be applied to AD survivors by researchers or clinicians, measuring outcomes after surgery and identifying those with worse health status.

Psychometric validation of the Korean version of PROMIS 29 Profile V2.1 among patients with lower extremity problems

Background

Patients with lower extremity problems (LEP) commonly experience functional loss, pain, decreased range of motion, inadequacy in daily living activities, and structural change in radiographic evaluations. However, the traditional patient-reported outcome measurement which focused on symptoms, had a limited scope of applicability. This study aimed to validate the psychometric properties of the Korean version of PROMIS-29 Profile v2.1 (K-PROMIS-29 V2.1), a multi-dimensional measure for assessing generic profile health-related quality-of-life (HRQoL) in a sample of patients with lower extremity problems (LEP).

Methods

Participants were recruited from the orthopedic outpatient clinics at the Samsung Medical Center in Seoul, South Korea from September to October 2018. Participants completed a survey questionnaire that included the K-PROMIS-29 V2.1 and the SF-36v2. Principal component analysis (PCA) and confirmatory factor analysis (CFA) and Pearson’s correlations were used to evaluate the reliability and validity of the K-PROMIS-29 V2.1.

Results

A total of 299 participants were enrolled in the study and 258 (86%) completed the study questionnaire. The mean age (SD) of the participants was 56.6 (14.5) and 32.3%, 29.8, and 25.2% of the study participants visited outpatient clinics for foot, knee, and hip problems respectively. The Cronbach’s alpha coefficients of 7 sub-domains in K-PROMIS-29 V2.1 ranged from 0.80 to 0.95, indicating satisfactory internal consistency. In CFA, the goodness-of-fit indices were high (CFI = 0.937 and SRMR = 0.061). High to moderate correlations were found between comparable subscales of the K-PROMIS-29 V2.1 and subscales of the SF-36v2 (r = 0.55–0.70).

Conclusions

The K-PROMIS-29 V2.1 is a reliable and valid measure for assessing a broad range of health-related quality-of-life domains in patients with LEP. It would reflect the real-life symptoms experienced by patients with LEP.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13102-021-00374-1.

Alteration in perceived health status of those aged 55 to 65 between 2010 and 2017 in France: role of socioeconomic determinants

BACKGROUND

While life expectancy increases, it is necessary to evaluate whether the additional years are lived in good health, particularly in order to adapt the health care provision and social measures available to support these individuals. Since the 1990s, improvements in perceived health and capacities have been observed among older people, however the changes appear to be far less favourable among the working-age population and, in particular, the generation of people approaching retirement age. The aim of this study was to examine the change in the perceived health status of those aged 55 to 65 in France and investigate the role of socioeconomic factors in this change.

METHODS

Self-reported health (SRH), chronic condition and activity limitation were assessed in 2010 and in 2017 in the French Health Barometer, a general population phone survey conducted on over 25,000 persons living in the community. The prevalence of all three indicators in 2017, and their evolution between 2010 and 2017 were studied according to the main socioeconomic determinants.

RESULTS

Between 2010 and 2017, there was a sharp increase in the proportion of individuals aged 55-65 reporting poor SRH, chronic condition or activity limitation. A much more marked deterioration was observed in the three indicators among those aged 55-65 than in older age groups, as well as different changes according to socioeconomic determinants. The category of workers with an average level of education was particularly affected by the deterioration.

CONCLUSIONS

This study confirms that the generation approaching retirement age presents a more significant deterioration in health status than those of previous generations. The question of how these trends will be reflected in terms of the burden of dependency at later ages remains open and should encourage increased monitoring of and prevention among this population in future years.

The Norwegian PROMIS-29: psychometric validation in the general population for Norway

Background

The Patient Reported Outcome Measurement Information System profile instruments include “high information” items drawn from large item banks following the application of modern psychometric criteria. The shortest adult profile, PROMIS-29, looks set to replace existing short-form instruments in research and clinical practice. The objective of this study was to undertake the first psychometric evaluation of the Norwegian PROMIS-29, following a postal survey of a random sample of 12,790 Norwegians identified through the National Registry of the Norwegian Tax Administration. Confirmatory factor analysis was used to assess structural validity. Fit to the Rasch partial credit model and differential item functioning (DIF) were assessed in relation to age, gender, and education. PROMIS-29 scores were compared to those for the EQ-5D-5L and the Self-assessed Comorbidity Questionnaire (SCQ), for purposes of assessing validity based on a priori hypotheses.

Results

There were 3200 (25.9%) respondents with a mean age (SD) of 51 (20.7, range 18 to 97 years) and 55% were female. The PROMIS-29 showed satisfactory structural validity and acceptable fit to Rasch model including unidimensionality, and measurement invariance across age and education levels. One pain interference item had uniform DIF for gender but splitting gave satisfactory fit. Domain reliability estimates ranged from 0.85 to 0.95. Correlations between PROMIS-29 domain, SCQ and EQ-5D scores were largely as expected, the largest being for scores assessing very similar aspects of health.

Conclusions

The Norwegian version of the PROMIS-29 is a reliable and valid generic self-reported measure of health in the Norwegian general population. The instrument is recommended for further application, but the analysis should be replicated and responsiveness to change assessed in future studies before it can be recommended for clinical and health services evaluation in Norway.

Supplementary Information

The online version contains supplementary material available at 10.1186/s41687-021-00357-3.

[Routine collection of perceived health data in the era of payment for quality: Recommendations by the Epidemiology and public health commission of the SFNDT]

In France, the method of financing is mainly based on the quantity of care produced. The fixed-rate financing of patients with chronic kidney disease at stage IV or V introduces the notion of payment to quality. Part of the quality assessment will focus on the patients' feelings about their care. The objective of this paper is to assess these indicators used in nephrology, markers in their own right of the quality of care. The patients reported outcomes measures considering the impact of illness or care and the Patient Reported Experience Measures considering their perception of their experience with the health care system or care pathway, are broader than quality of life. These PROs are measured using standardized and validated questionnaires, generic or specific. The Standardised Outcomes in Nephrology initiative has shown that PROs, too often neglected in favor of biological criteria, are instead favored by patients. In the context of a broad deployment of monitoring the quality of life for the purpose of evaluation of care, outside research protocol, the Commission recommends one of the following 2 tools: EuroQol 5D and 12-Item Short Form Health Survey, a compromise between feasibility and relevance and e-SATIS given its great use in health facilities, with an annual follow-up.

Responsiveness of Patient-Reported Outcomes to Treatment Among Patients With Type 2 Diabetes Mellitus and OSA

BACKGROUND

The Patient-Reported Outcomes Measurement Information System (PROMIS) includes two instruments to quantify sleep symptoms (sleep disturbance [SDA] and sleep-related impairment [SRI]) in diverse populations across a wide symptom spectrum. However, the responsiveness of PROMIS measures to treatment of sleep disorders is unknown. We examined the responsiveness of the PROMIS sleep scales to the treatment of OSA.

METHODS

We collected SDA, SRI, and Epworth Sleepiness Scale (ESS) before and after initiation of positive airway pressure (PAP) in patients with type 2 diabetes newly diagnosed with OSA. To compare responsiveness, we compared effect sizes and classifications of symptom improvement using both the reliable change method and thresholds of minimum important difference (MID).

RESULTS

A total of 103 patients completed assessments pre- and post-PAP. SDA, SRI, and ESS scores all declined significantly with PAP therapy. We observed the largest effect size for SDA (-0.64; 95% CI, -0.86 to -0.42), followed by SRI (-0.43; 95% CI, -0.63 to -0.23), and ESS (-0.28; 95% CI, -0.42 to -0.15). More patients experienced the reliable change category of symptom remission categorized by the PROMIS measures (SDA: 23.3%; SRI: 31.1%) relative to the ESS (5.8%) (P < .001 for both). Using the MID, SDA and SRI also classified more patients as improved (SDA: 54.4%; SRI: 49.5%) relative to the ESS (35.0%) (P < .001 for both pairwise comparisons).

CONCLUSIONS

PROMIS sleep measures were more likely than the ESS to detect an improvement with PAP therapy. Incorporating PROMIS measures into research and clinical care may provide a more sensitive assessment of symptomatic response to OSA treatment.