Feasibility and construct validity of PROMIS and "legacy" instruments in an academic scleroderma clinic

Efficiency, Precision, Validity, and Reliability of GlauCAT-Asian Computerized Adaptive Tests in Measuring Glaucoma-Related Quality of Life

Purpose

To determine the efficiency, precision, and agreement of GlauCAT-Asian and its corresponding validity and reliability.

Methods

In this cross-sectional study, 219 participants (mean ± standard deviation age, 66.59 ± 8.61 years; 34% female) across the spectrum of glaucoma severity and 50 glaucoma suspects were recruited from glaucoma clinics in Singapore. Participants answered seven computerized adaptive testing (CAT) evaluations (Ocular Comfort, Activity Limitation, Lighting, Mobility, Concerns, Psychosocial, Glaucoma Management) and underwent eye examinations. Efficiency (mean number of items required for each CAT and time taken for CAT versus full item banks [IBs]), agreement (concordance between CATs and full IB person measures, henceforth referred to as scores), and precision (standard error of measurement [SE]) were evaluated. Other validity and reliability metrics were also assessed.

Results

The mean number of items administered ranged from 9 (Mobility/Glaucoma Management) to 12 (Ocular Comfort). Compared to answering the full IBs, CATs provided an average time saving of 38.3% (range, 10% to 70.6% for Lighting and Activity Limitation, respectively). Agreement between scores obtained by CAT versus full IB was high (intracorrelation coefficient ≥0.75), as was precision of score estimates (mean SE range: 0.35 for Psychosocial to 0.29 for Mobility). Scores from Activity Limitation, Mobility, Lighting, and Concerns decreased significantly as glaucoma severity increased (criterion validity; P-trend <0.05). All tests displayed good convergent/divergent validity and test-retest reliability.

Conclusions

GlauCAT-Asian provides efficient, precise, accurate, valid, and reliable measurement of the patient-centered impact of glaucoma.

Translational Relevance

GlauCAT-Asian may provide a valuable clinical tool for ophthalmologists to monitor impact of disease progression and the effectiveness of therapies.

Female patients delay seeking medical care with alcohol-associated acute pancreatitis

BACKGROUND/OBJECTIVE

Alcohol consumption is increasing in women, who more frequently report abdominal symptoms compared to men. We aimed to examine differences in presentation of acute pancreatitis [AP] in male and female patients hospitalized with alcohol-associated AP.

METHODS

We analyzed 138 patients enrolled in an ongoing case-crossover study of alcohol-associated AP conducted across 5 medical centers in the U.S. Patients meeting the Revised Atlanta Classification of AP and who scored 3 or higher on the AUDIT-C instrument were invited to participate in the study and were interviewed while hospitalized with AP. Sex differences in the timing and type of pancreas-associated pain, alcohol consumption, clinical presentation, and quality of life were examined by Chi-squared tests, Wilcoxon rank sum tests and t-tests.

RESULTS

Female patients reported significantly longer interval from onset of pain to deciding to seek medical attention (median 40 h, interquartile range [IQR] 14, 74) as compared to males (14 h, IQR 4, 50; p = 0.005). While male patients were more likely to have been admitted to the intensive care unit [ICU] (21%) as compared to female patients (7%; p = 0.04), the incidence of SIRS or severe AP did not differ by sex. Quality of life measures as reported through the PROMIS-29 instrument were equally suboptimal in both sexes. Anxiety disorders were diagnosed more frequently among females (61%) than in males (41%, p = 0.009).

CONCLUSION

In a large case series of alcohol-associated AP, we found that female patients delayed seeking medical care compared to males. However, there were no differences in the type, location and intensity of abdominal pain.

Patterns of patient-reported symptoms and association with sociodemographic and systemic sclerosis disease characteristics: a scleroderma Patient-centered Intervention Network (SPIN) Cohort cross-sectional study

Background

Systemic sclerosis is a heterogenous disease in which little is known about patterns of patient-reported symptom clusters. We aimed to identify classes of individuals with similar anxiety, depression, fatigue, sleep disturbance, and pain symptoms and to evaluate associated sociodemographic and disease-related characteristics.

Methods

This multi-centre cross-sectional study used baseline data from Scleroderma Patient-centered Intervention Network Cohort participants enrolled from 2014 to 2020. Eligible participants completed the PROMIS-29 v2.0 measure. Latent profile analysis was used to identify homogeneous classes of participants based on patterns of anxiety, depression, fatigue, sleep disturbance, and pain scores. Sociodemographic and disease-related characteristics were compared across classes.

Findings

Among 2212 participants, we identified five classes, including four classes with "Low" (565 participants, 26%), "Normal" (651 participants, 29%), "High" (569 participants, 26%), or "Very High" (193 participants, 9%) symptom levels across all symptoms. Participants in a fifth class, "High Fatigue/Sleep/Pain and Low Anxiety/Depression" (234 participants, 11%) had similar levels of fatigue, sleep disturbance, and pain as in the "High" class but low anxiety and depression symptoms. There were significant and substantive trends in sociodemographic characteristics (age, education, race or ethnicity, marital or partner status) and increasing disease severity (diffuse disease, tendon friction rubs, joint contractures, gastrointestinal symptoms) across severity-based classes. Disease severity and sociodemographic characteristics of "High Fatigue/Sleep/Pain and Low Anxiety/Depression" class participants were similar to the "High" severity class.

Interpretation

Most people with systemic sclerosis can be classified by levels of patient-reported symptoms, which are consistent across symptoms and highly associated with sociodemographic and disease-related variables, except for one group which reports low mental health symptoms despite high levels of other symptoms and substantial disease burden. Studies are needed to better understand resilience in systemic sclerosis and to identify and facilitate implementation of cognitive and behavioural strategies to improve coping and overall quality of life.

Funding

National Institute of Nursing Research (F31NR019007), Canadian Institutes of Health Research, Arthritis Society Canada, the Lady Davis Institute for Medical Research, the Jewish General Hospital Foundation, McGill University, Scleroderma Society of Ontario, Scleroderma Canada, Sclérodermie Québec, Scleroderma Manitoba, Scleroderma Atlantic, Scleroderma Association of BC, Scleroderma SASK, Scleroderma Australia, Scleroderma New South Wales, Scleroderma Victoria, and Scleroderma Queensland.

Predictors and Interrelationship of Patient-Reported Outcomes in Antiphospholipid Syndrome: A Cross-Sectional Study

OBJECTIVE

This study assessed patient-reported outcomes (PROs) in individuals with persistently positive antiphospholipid antibodies (aPL) to better understand how living with aPL may affect their quality of life.

METHODS

Patients completed Patient-Reported Outcomes Measurement Information System Physical Function (PF) and Cognitive Function (CF) Short Forms as well as the pain intensity (PI) rating (scale of 1-10). Patients were characterized for demographics, clinical manifestations of antiphospholipid syndrome (APS), cardiovascular risk factors, laboratory test results, and medication usage. Multivariate modeling was done via linear regression.

RESULTS

Of 139 patients, 89 had primary APS, 21 had secondary APS, and 29 had persistent aPL without meeting clinical criteria for APS. The average T scores (±SD) for PF and CF were 45.4 ± 9.2 and 48.6 ± 11.6, respectively; the average for PI was 3.0 ± 2.6. Approximately half of the patients (47%) endorsed at least mild impairment in PF (T score < 45). Mean PF, CF, and PI did not differ between diagnostic groups. Individuals who endorsed more impairment on one measure also tended to endorse more impairment on another (Pearson r = 0.43-0.59). In the multivariate models, age, smoking, pain medications, and serotonergic medications were associated with impairment in at least one PRO domain. The Damage Index for APS was significantly correlated with both PF and CF.

CONCLUSION

Individuals living with APS endorsed more impairment in PF (and potentially CF) than expected for the general population. The relationship between certain medications and PROs warrants further study, as does the longitudinal trajectory of these and other PROs.

Validation of the Swedish version of PROMIS-29v2 and FACIT-Dyspnea Index in patients with systemic sclerosis

PURPOSE

To evaluate the reliability, internal consistency, and construct validity of the Swedish versions of PROMIS-29 and Functional Assessment of Chronic Illness Therapy-Dyspnea (FACIT-Dyspnea) instruments in patients with systemic sclerosis (SSc).

METHODS

In a cross-sectional study, consecutive SSc patients completed a paper-based survey. Internal consistency was assessed using Cronbach's alpha. Test-retest reliability was tested employing weighted Kappa (K_w) and intra-class correlation coefficient (ICC). Construct validity was evaluated by hypotheses testing using RAND-36, MRC Dyspnea score, Scleroderma Health Assessment Questionnaire (SHAQ) and clinical measurements.

RESULTS

Forty-nine patients (86% female; 73% limited cutaneous SSc) completed the survey. The mean disease duration was 11 years and mean SHAQ was 0.5. Internal consistency and test-retest reliability were good with the exception of PROMIS-29 anxiety. PROMIS-29, FACIT-Dyspnea, and Functional limitation showed strong correlations to corresponding RAND-36 domains (|r_s|=0.67 to -0.85). Relevant PROMIS-29 domains, FACIT-Dyspnea and Functional limitation correlated strongly to SHAQ and VAS overall disease severity (|r_s|=0.60 to -0.75). Ceiling effects (>15%) were found in six PROMIS-29 domains and in both FACIT-Dyspnea and Functional limitations. Four (4/5) hypotheses were confirmed.

CONCLUSIONS

PROMIS-29 and FACIT-Dyspnea meet the requirements for reliability and have adequate construct validity in Swedish patients with SSc.Implications for rehabilitationPROMIS-29v2 and Functional Assessment of Chronic Illness Therapy-Dyspnea (FACIT-Dyspnea) Index are patient outcome measures that gain increasing interest for the evaluation of patient with rheumatologic diseases.PROMIS-29v2 and FACIT-Dyspnea Index meet the requirements for reliability and have adequate construct validity compared to legacy measures in Swedish patients with systemic sclerosis.Translation and validation of PROMs is important for studies of rare diseases in multi-center collaborations.

Depression, stigma and social isolation: the psychosocial trifecta of primary chronic cutaneous lupus erythematosus, a cross-sectional and path analysis

Objective

Depression is common in individuals with chronic cutaneous lupus erythematosus (CCLE). However, how CCLE may impact patients’ psychological well-being is poorly understood, particularly among disproportionally affected populations. We examined the relationships between depression and psychosocial factors in a cohort of predominantly Black patients with primary CCLE (CCLE without systemic manifestations).

Methods

Cross-sectional assessment of individuals with dermatologist-validated diagnosis of primary CCLE. NIH-PROMIS short-forms were used to measure depression, disease-related stigma, social isolation and emotional support. Linear regression analyses (ɑ=0.05) were used to test an a priori conceptual model of the relationship between stigma and depression and the effect of social isolation and emotional support on that association.

Results

Among 121 participants (87.6% women; 85.1% Black), 37 (30.6%) reported moderate to severe depression. Distributions of examined variables divided equally among those which did (eg, work status, stigma (more), social isolation (more), emotional support (less)) and did not (eg, age, sex, race, marital status) significantly differ by depression. Stigma was significantly associated with depression (b=0.77; 95% CI0.65 to 0.90), whereas social isolation was associated with both stigma (b=0.85; 95% CI 0.72 to 0.97) and depression (b=0.70; 95% CI0.58 to 0.92). After controlling for confounders, stigma remained associated with depression (b=0.44; 95% CI0.23 to 0.66) but lost significance (b=0.12; 95% CI −0.14 to 0.39) when social isolation (b=0.40; 95% CI 0.19 to 0.62) was added to the model. Social isolation explained 72% of the total effect of stigma on depression. Emotional support was inversely associated with depression in the univariate analysis; however, no buffer effect was found when it was added to the multivariate model.

Conclusion

Our findings emphasise the psychosocial challenges faced by individuals living with primary CCLE. The path analysis suggests that stigmatisation and social isolation might lead to depressive symptoms. Early clinical identification of social isolation and public education demystifying CCLE could help reduce depression in patients with CCLE.

Mental Health Care Use and Associated Factors in Systemic Sclerosis: A Scleroderma Patient-Centered Intervention Network Cohort Study

Objective

Systemic sclerosis (SSc) has significant psychosocial implications. We aimed to evaluate the proportion of participants in a large international SSc cohort who used mental health services in a 3‐month period and to evaluate demographic, psychological, and disease‐specific factors associated with use.

Methods

Baseline data of participants enrolled in the Scleroderma Patient‐Centered Intervention Network Cohort were analyzed. We determined the proportion that used mental health services and the source of services in the 3 months prior to enrollment. Multivariable logistic regression was used to identify variables associated with service use.

Results

Of the 2319 participants included in the analysis, 417 (18%) used mental health services in the 3 months prior to enrollment. General practitioners were the most common mental health service providers (59%), followed by psychologists (25%) and psychiatrists (19%). In multivariable analysis, mental health service use was independently associated with higher education (odds ratio [OR] 1.07, 95% confidence interval [CI] 1.03‐1.11), smoking (OR 1.06, 95% CI 1.02‐1.11), being retired (OR 0.60, 95% CI 0.38‐0.93), having limited SSc (OR 1.39, 95% CI 1.02‐1.89), and having higher anxiety symptom scores (OR 1.04, 95% CI 1.03‐1.06) and lower self‐efficacy scores (OR 0.90, 95% CI 0.83‐0.97). Variables not significantly associated included age, race, disease manifestations, depression symptom scores, and body image distress.

Conclusion

About 18% of participants in a large international cohort received mental health services in a 3‐month period, of whom the majority received these services from a general practitioner.

Does the Patient-Reported Outcomes Measurement Information System Correlate to Legacy Scores in Measuring Physical Health in Young Total Hip Arthroplasty Patients?

BACKGROUND

The Patient-Reported Outcomes Measurement Information System (PROMIS) was developed by the National Institutes of Health to collect outcome data in rapid dynamic fashion on electronic platforms. The potential role of PROMIS in monitoring pain and function in young total hip arthroplasty (THA) patients has been under-investigated. The purpose of this study is to investigate correlation between PROMIS Physical Function (PF) and PROMIS Pain Interference (PI) and legacy scores with similar considerations.

METHODS

We identified 298 hips who underwent primary THA over 40 months. Patients without preoperative PROMIS or legacy scores, or >50 years were excluded. Demographic data included age, gender, and body mass index. Outcome data included PF, PI, modified Harris Hip Score (mHHS), Western Ontario and McMasters Universities Osteoarthritis Index (WOMAC) domains, and Short Form 12 components. Floor/ceiling effects were considered to be significant if ≥15% of patients responded with the lowest or highest possible score. Spearman correlation (R) was performed to investigate correlation between legacy scores and PROMIS domains.

RESULTS

Mean age was 40 years, mean body mass index was 30.1 kg/m², and 55% were female. None of the patient-reported outcome measures showed any floor/ceiling effects. PI showed moderate correlation to mHHS (R = -0.60), WOMAC Pain (R = -0.62), and WOMAC PF (R = -0.60). PF showed moderate correlation to mHHS (R = 0.66) and WOMAC PF (R = 0.55). Mean PF and PI scores differed significantly from the general population mean of 50 (36.7, 65.4, respectively; both P < .001).

CONCLUSION

PROMIS is an attractive alternative to legacy scoring measures, showing moderate correlations between PROMIS physical domains and legacy PROMs of WOMAC and mHHS in young patients undergoing THA.

Validating the Patient-Reported Outcomes Measurement Information System Short Form v1.0-Anxiety 8a in a sample of young adult cancer survivors: Comparison with a structured clinical diagnostic interview

BACKGROUND

The objective of this study was to validate the Patient-Reported Outcomes Measurement Information System Short Form v1.0-Anxiety 8a (PROMIS-A-SF) against a structured diagnostic interview in order to determine its accuracy and the most appropriate cutoff score for identifying anxiety disorders in young adult cancer survivors (YACSs).

METHODS

Two hundred forty-nine YACSs aged 18 to 40 years (50% male) completed the PROMIS-A-SF and the Structured Clinical Interview for the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (SCID). The SCID was used to determine whether participants met the criteria for an anxiety diagnosis. Receiving operator characteristic analyses were performed to determine the concordance of the PROMIS-A-SF and the SCID as well as cutoff scores with sensitivity (≥0.85) and specificity (≥0.75) appropriate for an anxiety screening measure.

RESULTS

The PROMIS-A-SF was determined to have good overall discrimination in comparison with the SCID (area under the curve, 0.84). A PROMIS-A-SF t-score cutoff ≥ 53.2 (total predictive value, 67.9%) came closest to meeting the study criteria with a sensitivity of 88%, but the specificity was only 65%. In a hypothetical screening example, this cutoff led to moderate levels of missed cases (14%) and a significant proportion of clinical referrals that were unnecessary by SCID criteria (35%). Of the survivors referred for services according to these criteria, less than one-third (29%) would have a SCID anxiety diagnosis.

CONCLUSIONS

The PROMIS-A-SF demonstrated moderately strong concordance with anxiety disorders measured by the SCID, but cutoff scores did not meet study criteria for clinical screening. Although it may not be appropriate as a standalone screener, the PROMIS-A-SF may be useful for assessing anxiety in YACSs when it is incorporated into clinical practice or when it is combined with other measures.

Psychometric properties of the PROMIS-57 questionnaire, Norwegian version

Purpose

The aims of this cross-sectional study were to explore reliability and validity of the Norwegian version of the Patient-Reported Outcome Measurement System^®—Profile 57 (PROMIS-57) questionnaire in a general population sample, n = 408, and to examine Item Response properties and factor structure.

Methods

Reliability measures were obtained from factor analysis and item response theory (IRT) methods. Correlations between PROMIS-57 and RAND-36-item health survey (RAND36) were examined for concurrent and discriminant validity. Factor structure and IRT assumptions were examined with factor analysis methods. IRT Item and model fit and graphic plots were inspected, and differential item functioning (DIF) for language, age, gender, and education level were examined.

Results

PROMIS-57 demonstrated excellent reliability and satisfactory concurrent and discriminant validity. Factor structure of seven domains was supported. IRT assumptions were met for unidimensionality, local independence, monotonicity, and invariance with no DIF of consequence for language or age groups. Estimated common variance (ECV) per domain and confirmatory factor analysis (CFA) model fit supported unidimensionality for all seven domains. The GRM IRT Model demonstrates acceptable model fit.

Conclusions

The psychometric properties and factor structure of Norwegian PROMIS-57 were satisfactory. Hence, the 57-item questionnaire along with PROMIS-29, and the corresponding 8 and 4 item short forms for physical function, anxiety, depression, fatigue, sleep disturbance, social participation ability and pain interference, are considered suitable for use in research and clinical care in Norwegian populations. Further studies on longitudinal reliability and sensitivity in patient populations and for Norwegian item calibration and/or reference scores are needed.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11136-021-02906-1.

Patients and clinicians define symptom levels and meaningful change for PROMIS pain interference and fatigue in RA using bookmarking

OBJECTIVES

Using patient-reported outcomes to inform clinical decision-making depends on knowing how to interpret scores. Patient-Reported Outcome Measurement Information System® (PROMIS®) instruments are increasingly used in rheumatology research and care, but there is little information available to guide interpretation of scores. We sought to identify thresholds and meaningful change for PROMIS Pain Interference and Fatigue scores from the perspective of RA patients and clinicians.

METHODS

We developed patient vignettes using the PROMIS item banks representing a continuum of Pain Interference and Fatigue levels. During a series of face-to-face 'bookmarking' sessions, patients and clinicians identified thresholds for mild, moderate and severe levels of symptoms and identified change deemed meaningful for making treatment decisions.

RESULTS

In general, patients selected higher cut points to demarcate thresholds than clinicians. Patients and clinicians generally identified changes of 5-10 points as representing meaningful change. The thresholds and meaningful change scores of patients were grounded in their lived experiences having RA, approach to self-management, and the impacts on function, roles and social participation.

CONCLUSION

Results offer new information about how both patients and clinicians view RA symptoms and functional impacts. Results suggest that patients and providers may use different strategies to define and interpret RA symptoms, and select different thresholds when describing symptoms as mild, moderate or severe. The magnitude of symptom change selected by patients and clinicians as being clinically meaningful in interpreting treatment efficacy and loss of response may be greater than levels determined by external anchor and statistical methods.

Patient-Reported Outcomes Measurement Information System Correlates With Modified Harris Hip Score in Total Hip Arthroplasty

The modified Harris Hip Score (mHHS) is a validated and disease-specific instrument commonly used to assess outcomes in total hip arthroplasty (THA). The Patient-Reported Outcomes Measurement Information System (PROMIS) is a validated, computer adaptive testing (CAT)-based global health assessment tool. The authors' goal was to examine the correlation between PROMIS Pain Interference and Physical Function CATs and the mHHS in patients undergoing primary THA. All THAs were performed by 1 of 2 fellowship-trained dedicated total joint surgeons at 1 academic institution. Patients completed PROMIS and mHHS assessments preoperatively and at 3, 6, 12, and 52 weeks postoperatively. Descriptive statistics and Pearson correlation values were determined. A total of 48 patients were prospectively enrolled in the study. Preoperatively, mean total PROMIS score (Pain Interference and Physical Function) was 74.2 and mHHS was 50.8. Preoperatively, mean total PROMIS score showed a moderate correlation (r=0.56; P<.0001) with total mHHS. Postoperatively, mean total PROMIS score at 3, 6, 12, and 52 weeks was 82.4, 93.4, 100, and 100, respectively (all P<.01 vs baseline), and mHHS was 68.2, 81.1, 85.9, and 88.6, respectively (all P<.01). At 3, 6, 12, and 52 weeks postoperatively, a strong and consistent correlation was observed between the total PROMIS score and mHHS (r=0.74, 0.74, 0.73, and 0.80, respectively; all P<.0001). The PROMIS Pain Interference and Physical Function CATs accurately assessed preoperative pain and dysfunction, as well as clinical improvement following THA. Combined PROMIS Pain Interference and Physical Function is comparable to the mHHS when assessing outcome following THA for osteoarthritis. [Orthopedics. 2021;44(1):e19-e25.].

Is the Patient-Reported Outcome Measurement Information System Feasible in Bundled Payment for Care Improvement Total Knee Arthroplasty Patients?

BACKGROUND

Several bundled payment plans, like the Bundled Payment for Care Improvement (BPCI) initiative for total joint arthroplasty, have been introduced to decrease costs and improve clinical care. Measuring clinical outcomes with efficient, standardized methodologies is essential to determine the relative value of total joint arthroplasty care. We investigated feasibility and responsiveness of the recently developed Patient-Reported Outcomes Measurement Information System (PROMIS) in total knee arthroplasty (TKA) patients.

METHODS

We included patients with preoperative and 1-year PROMIS Physical Function (PF), Pain Interference (PI), and Depression (DEP) scores who received unilateral primary TKA. Burden was assessed using the number of questions and time required for PROMIS completion. The minimum clinically important difference was defined as 5. Floor/ceiling effects were noted if more than 15% of patients responded with the lowest/highest possible score, respectively. Wilcoxon rank-sum test was used to compare categorical data. Analysis of variance was used for PROMIS comparisons.

RESULTS

In total, 172 knees (54 BPCI) were included. Floor effects were identified for DEP at baseline (non-BPCI) and follow-up (both groups), and for PI at follow-up only (BPCI). Patients required 140 seconds and 16 questions to answer all 3 PROMIS domains. Sixty-seven percent, 60%, and 44% of knees achieved minimum clinically important difference in PI, PF, and DEP scores respectively, with no significant difference between groups. The BPCI cohort was older (P < .001) with a higher American Society of Anesthesiologists score (P = .028). There were no significant differences in scores between BPCI and non-BPCI patients.

CONCLUSION

PROMIS is feasible and time-efficient in BPCI patients undergoing primary TKA. There were no significant differences in outcomes between BPCI and non-BPCI knees.

LEVEL OF EVIDENCE

Level III.

Methodological and Statistical Considerations for the National Children's Study

The National Children's Study (NCS) statistics and item response theory group was tasked with promoting the quality of study measures and analysis. This paper provides an overview of six measurement and statistical considerations for the NCS: (1) Conceptual and Measurement Model; (2) Reliability; (3) Validity; (4) Measurement Invariance; (5) Interpretability of Scores; and (6) Burden of administration. The guidance was based primarily on recommendations of the International Society of Quality of Life Research.

Performance of PROMIS Physical Function, Pain Interference, and Depression Computer Adaptive Tests Instruments in Patients Undergoing Meniscal Surgery

Purpose

To compare the performance of the Patient-Reported Outcomes Measurement Information System (PROMIS) physical function (PF), pain interference (PIF), and depression computer adaptive tests (CAT) relative to legacy instruments in patients undergoing meniscal surgery.

Methods

Patients scheduled to undergo meniscal surgery completed legacy knee function PROMs (International Knee Documentation Committee [IKDC], Knee Injury and Osteoarthritis Outcome Score [KOOS] subscores), Marx Activity Rating Scale (MARS), Veterans-Rand 12 (VR12), Short Form 12 (SF12), and the Brief Resilience Scale (BRS) alongside PROMIS PF, PIF, and Depression preoperatively. Spearman rank correlations were calculated, and score distributions were examined for floor and ceiling effects.

Results

152 patients (46.6 ± 14.9 years, 67.1% male) completed PROMs for appropriate inclusion. PROMIS PF yielded high-moderate to high correlations with the IKDC and KOOS subscales (r = 0.61 to 0.73), demonstrating similar performance to the IKDC. PROMIS PIF demonstrated moderately high-moderate to high correlations with the IKDC, KOOS subscales, VR-12 Physical Component Score (PCS), and SF12 PCS (r = 0.62 to 0.71), performing comparably to KOOS Pain (r = 0.55 to 0.92). PROMIS Depression demonstrated moderate to high-moderate correlations with the mental health legacies (r = 0.46 to 0.66). Significant ceiling effects were observed for MARS (n = 29, 18.8%), and significant floor effects were exhibited by PROMIS Depression (n = 38, 25%) and MARS (n = 27, 17.6%).

Conclusion

The PROMIS PF, PIF CAT, and Depression instruments exhibit comparable performance profiles relative to legacy knee PROMs. PROMIS PF and PIF demonstrated no floor and ceiling effects, whereas PROMIS Depression exhibited a significant relative floor effect. PROMIS PF and PIF may be appropriately used to establish functional baselines preoperatively.

Level of Evidence

IV, diagnostic case series.

Comparison of patient-reported outcomes measurement information system and legacy instruments in multiple domains among older veterans with chronic back pain

Background

Chronic low back pain (cLBP) results in significant physical, psycho-social and socioeconomic burden. Identifying efficient and reliable patient reported outcome measures is critical for research and clinical purposes. The NIH’s Patient Reported Outcomes Measurement Information System (PROMIS) instruments have not been compared to validated “legacy” instruments in older adults with cLBP. This study evaluates construct (convergent and discriminant) validity and time to complete (TTC) PROMIS as compared to legacy instruments.

Methods

We enrolled older Veterans (age 60+) with cLBP with/without leg pain scheduled for lumbar epidural steroid injections. Subjects completed PROMIS computer adaptive test item banks and corresponding legacy instruments in the following domains: pain intensity, interference, and behavior; functional status; depression and anxiety; fatigue; sleep and social functioning. Convergent and discriminant validity between PROMIS and legacy instruments was evaluated using Spearman rank order correlations; Mann-Whitney U tests compared TTC.

Results

Of the 71 Veterans recruited, the median (IQR) age was 67 (63–71) years old, 94% were men, 76% were White, 17% Black, and 96% were Non-Hispanic. Spearman correlations between PROMIS and legacy instruments showed moderate to very strong convergent validity in all domains (r = 0.4–1.0), except for social functioning and pain behavior (PROMIS Pain Behavior with Fear Avoidance Belief Questionnaire). The total median TTC for all PROMIS items was significantly shorter than legacy items, 8 min 50 s vs 29 min 14 s respectively, p < 0.001.

Conclusions

Given time efficiency of using PROMIS, along with strong construct validity, PROMIS instruments are a practical choice for measuring multidimensional PROs in older Veterans with cLBP for both research and clinical purposes.

Can Patient-Reported Outcomes Measurement Information System® (PROMIS) measures accurately enhance understanding of acceptable symptoms and functioning in primary care?

BACKGROUND

Value-based healthcare models will require prioritization of the patient's voice in their own care toward better outcomes. The Patient-Reported Outcomes Measurement Information System® (PROMIS) gives patients a voice and leads providers to actionable treatments across a broad range of diagnoses. However, better interpretation of PROMIS measures is needed. The purpose of this study was to evaluate the accuracy of PROMIS Physical Function (PF), Self-Efficacy for Managing Symptoms (SE), Pain Interference (PI), Fatigue, and Depression measures to discriminate patient acceptable symptom state (PASS) in primary care, determining if that accuracy is stable over time and/or retained when PROMIS score thresholds are set at either ½ or 1 SD worse than the reference population mean.

METHODS

Primary care patients completed the five PROMIS measures and answered the PASS yes/no question at intake (n = 360), 3-14 days follow-up (n = 230), and 45-60 days follow-up (n = 227). Thresholds (optimal, ½ SD, and 1 SD worse than reference values) for PROMIS T-scores associated with PASS were determined through receiver-operator curve analysis. Accuracy was calculated at the three time points for each threshold value. Logistic regression analyses were used to determine combinations of PROMIS measures that best predicted PASS.

RESULTS

PROMIS PF, SE, PI, and Fatigue optimal score thresholds (maximizing sensitivity and specificity) yielded area under the curve values of 0.77-0.85, with accuracies ranging from 71.7% to 79.1%. Accuracy increased minimally (1.9% to 5.5%) from intake to follow-ups. Thresholds of 1 SD worse than the mean for PROMIS PF and PI measures and ½ SD worse for SE and Fatigue overall retained accuracy versus optimal (+ 1.3% to - 3.6%). Regression models retained SE, PI, and Fatigue as independent predictors of PASS, and minimally increased accuracy to 83.1?%.

CONCLUSIONS

This study establishes actionable PROMIS score thresholds that are stable over time and anchored to patient self-reported health status, increasing interpretability of PF, SE, PI, and Fatigue scores. The findings support the use of these PROMIS measures in primary care toward improving provider-patient communication, prioritizing patient concerns, and optimizing clinical decision making.

Is the Patient-Reported Outcome Measurement Information System Feasible in Bundled Payment for Care Improvement in Total Hip Arthroplasty Patients?

BACKGROUND

The Patient-Reported Outcomes Measurement Information System (PROMIS) is increasingly used to assess patient health. The Bundled Payment for Care Improvement (BPCI) initiative for total hip arthroplasty (THA) was introduced to decrease costs and improve clinical care. We investigated differences between BPCI and non-BPCI THA patients and their PROMIS scores, along with its feasibility and responsiveness in these populations.

METHODS

We included all consecutive patients receiving unilateral primary THA who also had preoperative and one-year postoperative PROMIS physical function (PF), PROMIS pain interference (PI), and PROMIS depression (DEP) scores. Demographics and PROMIS scores were compared. Test burden was assessed using the number of questions and time required for PROMIS completion. The minimum clinically important difference was defined as 5. Floor and ceiling effects were noted if more than 15% of patients responded with the lowest or highest possible score, respectively. Wilcoxon rank-sum test was used to compare categorical data. ANOVA was used for PROMIS comparisons.

RESULTS

290 hips (86 BPCI, 30%) were included. The BPCI cohort was older (P < .001) with a higher American Society of Anesthesiologists physical status classification system (P = .0045). There were significant differences in baseline scores of PF and DEP between BPCI and non-BPCI (P = .046 and P = .048, respectively). Both groups showed significant improvement at follow-up in all scores (all P < .001). Significantly more non-BPCI patients achieved minimum clinically important difference at follow-up in PI and PF (P = .047 and P = .023, respectively). Floor effects were identified for DEP at baseline and follow-up and for PI at follow-up only.

CONCLUSION

PROMIS is feasible and time-efficient in BPCI patients undergoing primary THA. There were significant differences between BPCI and non-BPCI hips.

LEVEL OF EVIDENCE

Level III.

Psychometric properties of the PROMIS® Fatigue Short Form 7a among adults with myalgic encephalomyelitis/chronic fatigue syndrome

PURPOSE

To evaluate the psychometric properties of the Patient-Reported Outcome Measurement Information System® Fatigue Short Form 7a (PROMIS F-SF) among people with Myalgic Encephalomyelitis/Chronic Fatigue Syndrome (ME/CFS).

METHODS

Analyses were conducted using data from the Multi-Site Clinical Assessment of ME/CFS study, which recruited participants from seven ME/CFS specialty clinics across the US. Baseline and follow-up data from ME/CFS participants and healthy controls were used. Ceiling/Floor effects, internal consistency reliability, differential item functioning (DIF), known-groups validity, and responsiveness were examined.

RESULTS

The final sample comprised 549 ME/CFS participants at baseline, 386 of whom also had follow-up. At baseline, the sample mean of PROMIS F-SF T-score was 68.6 (US general population mean T-score of 50 and standard deviation of 10). The PROMIS F-SF demonstrated good internal consistency reliability (Cronbach's α = 0.84) and minimal floor/ceiling effects. No DIF was detected by age or sex for any item. This instrument also showed good known-groups validity with medium-to-large effect sizes (η² = 0.08-0.69), with a monotonic increase of the fatigue T-score across ME/CFS participant groups with low, medium, and high functional impairment as measured by three different variables (p < 0.01), and with significantly higher fatigue T-scores among ME/CFS participants than healthy controls (p < 0.0001). Acceptable responsiveness was found with small-to-medium effect sizes (Guyatt's Responsiveness Statistic = 0.28-0.54).

CONCLUSIONS

Study findings support the reliability and validity of PROMIS F-SF as a measure of fatigue for ME/CFS and lend support to the drug development tool submission for qualifying this measure to evaluate therapeutic effect in ME/CFS clinical trials.

Reliability and Validity of Patient-reported Outcomes Measurement Information System Short Forms in Ankylosing Spondylitis

Objective.

To assess the reliability and validity in ankylosing spondylitis (AS) of selected Patient Reported Outcomes Measurement Information System (PROMIS) Short Forms (SF) developed by the US National Institutes of Health. The analysis was done across core sets and patient-identified domains of the Assessment of Spondyloarthritis international Society.

Methods.

Participants in the Prospective Study of Outcomes in Ankylosing Spondylitis (PSOAS), an ongoing, prospective longitudinal observational study, completed 6 PROMIS SF assessing global health, depression, fatigue, physical function, pain intensity, and pain interference during their PSOAS visits from September 2017 to January 2019. Test-retest reliability and internal consistency were assessed using intraclass correlation coefficients and Cronbach’s alpha coefficient, respectively. PROMIS SF were compared to legacy measures collected. Construct validity was evaluated through examination of score distributions and floor effects, and through examination of the Spearman correlation coefficients between PROMIS measures and existing legacy AS measures. Discriminant validity was tested across Ankylosing Spondylitis Disease Activity Score (ASDAS) groups.

Results.

Participants (n = 119) were mostly male (69%), white (81%), and with a mean (SD) age of 51 (± 15) years. Legacy measures demonstrated floor effects that were not present in PROMIS SF. Good test-retest reliability (r > 0.8) and excellent internal consistency (α > 0.9) was noted in the PROMIS SF. The 6 PROMIS SF correlated moderately to strongly [ρ 0.68 (Depression) to −0.87 (Physical Function)] with appropriate legacy measures. PROMIS scores measures worsened significantly (p < 0.05) with higher ASDAS groups.

Conclusion.

This study supports the reliability and construct validity of PROMIS SF to assess AS symptoms from a single-center sample of patients with AS. Further research is needed to test responsiveness, feasibility/resource burden, and different cultural/societal contexts for patients with AS.

Physical or Occupational Therapy Use in Systemic Sclerosis: A Scleroderma Patient-centered Intervention Network Cohort Study

OBJECTIVE

Systemic sclerosis (SSc) is characterized by significant disability because of musculoskeletal involvement. Physical and occupational therapy (PT/OT) have been suggested to improve function. However, the rate of PT/OT use has been shown to be low in SSc. We aimed to identify demographic, medical, and psychological variables associated with PT/OT use in SSc.

METHODS

Participants were patients with SSc enrolled in the Scleroderma Patient-centered Intervention Network (SPIN) Cohort. We determined the rate and indication of PT/OT use in the 3 months prior to enrollment. Multivariable logistic regression was used to identify variables independently associated with PT/OT use.

RESULTS

Of the 1627 patients with SSc included in the analysis, 23% used PT/OT in the preceding 3 months. PT/OT use was independently associated with higher education (OR 1.08, 95% CI 1.04-1.12), having moderately severe small joint contractures (OR 2.09, 95% CI 1.45-3.03), severe large joint contractures (OR 2.33, 95% CI 1.14-4.74), fewer digital ulcerations (OR 0.70, 95% CI 0.51-0.95), and higher disability (OR 1.54, 95% CI 1.18-2.02) and pain scores (OR 1.04, 95% CI 1.02-1.06). The highest rate of PT/OT use was reported in France (43%) and the lowest, in the United States (17%).

CONCLUSION

Despite the potential of PT/OT interventions to improve function, < 1 in 4 patients with SSc enrolled in a large international cohort used PT/OT services in the last 3 months. Patients who used PT/OT had more severe musculoskeletal manifestations and higher pain and disability.

Validation of the Computerized Adaptive Test for Mental Health in Primary Care

PURPOSE

The US Preventive Services Task Force recommends screening for depression in the general adult population. Although screening questionnaires for depression and anxiety exist in primary care settings, electronic health tools such as computerized adaptive tests based on item response theory can advance screening practices. This study evaluated the validity of the Computerized Adaptive Test for Mental Health (CAT-MH) for screening for major depressive disorder (MDD) and assessing MDD and anxiety severity among adult primary care patients.

METHODS

We approached 402 English-speaking adults for participation from a primary care clinic, of whom 271 adults (71% female, 65% black) participated. Participants completed modules from the CAT-MH (Computerized Adaptive Diagnostic Test for MDD, CAT-Depression Inventory, CAT-Anxiety Inventory); brief paper questionnaires (9-item Patient Health Questionnaire [PHQ-9], 2-item Patient Health Questionnaire [PHQ-2], Generalized Anxiety Disorder 7-item Scale [GAD-7]); and a reference-standard interview, the Structured Clinical Interview for DSM-5 (Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition) Diagnoses.

RESULTS

On the basis of the interview, 31 participants met criteria for MDD and 29 met criteria for GAD. The diagnostic accuracy of the Computerized Adaptive Diagnostic Test for MDD (area under curve [AUC] = 0.85) was similar to that of the PHQ-9 (AUC = 0.84) and higher than that of the PHQ-2 (AUC = 0.76) for MDD screening. Using the interview as the reference standard, the accuracy of the CAT-Anxiety Inventory (AUC = 0.93) was similar to that of the GAD-7 (AUC = 0.97) for assessing anxiety severity. The patient-preferred screening method was assessment via tablet/computer with audio.

CONCLUSIONS

Computerized adaptive testing could be a valid and efficient patient-centered screening strategy for depression and anxiety screening in primary care settings.

Validation of PROMIS emotional distress short form scales for cervical cancer

OBJECTIVES

Cervical cancer patients are at high risk for emotional distress. In this study we evaluate the PROMIS emotional distress-Depression and -Anxiety Short Forms for assessing depression and anxiety in a cervical cancer population.

METHODS

A 15-item questionnaire was used in a cervical cancer biobehavioral randomized clinical trial, testing psychosocial telephone counseling (PTC) against usual care (UC). It was administered to 204 patients prior to randomization, four months post-enrollment, and nine months post-enrollment, together with legacy measures of depression. The short forms were evaluated in patients participating in this study over three time points for internal consistency, convergent validity, and responsiveness to change over time.

RESULTS

Overall, 45% and 47% of patients scored in the moderate to severe range for anxiety and depression, respectively. Internal consistency coefficients were ≥ 0.95 at baseline, 4 months, and 9 months for depression and anxiety. The average inter-item correlation was 0.65 and 0.73 at baseline assessment for depression and anxiety, respectively. The depression short form T-score was correlated with legacy distress scales ranging from 0.44-0.76, and the anxiety short form ranging from 0.45-0.78. The depression short form demonstrated sensitivity to change as patients randomized to the counseling intervention reported greater improvement over time in depression (p = 0.014), and a nonsignificant improvement in anxiety, compared to the patients receiving usual care.

CONCLUSIONS

The PROMIS depression and anxiety short forms reliably and validly assess cervical cancer-specific emotional distress, capture salient features of distress in this population, and perform as well or better than legacy measures.

Feasibility of Patient-Reported Outcomes Measurement Information System (PROMIS®) computerized adaptive tests in systemic lupus erythematosus outpatients

Objective

The aims of this study were to assess the feasibility of administering Patient-Reported Outcomes Measurement Information System (PROMIS®) computerized adaptive tests (CATs) to outpatients with systemic lupus erythematosus (SLE).

Methods

Adults with SLE were recruited during routine outpatient visits at an SLE Center of Excellence. Participants completed 14 PROMIS CATs and provided feedback on their experience. Differences in socio-demographic and clinical characteristics between participants and non-participants were evaluated.

Results

A total of 204 (86%) of 238 socioeconomically and racially diverse SLE patients completed PROMIS CATs. There were no significant differences between participants and non-participants. Time constraints were cited most frequently as reasons for non-participation. More than 75% of individuals submitted positive comments, including approval of the content and format of questions, and the survey’s promotion of self-reflection. A minority of participants cited challenges, most often related to question phrasing (8%) and technical difficulties (6%).

Conclusions

The administration of PROMIS CATs was feasible and positively received in a diverse cohort of SLE outpatients. Neither socio-demographic nor disease characteristics were significant barriers to successful completion of PROMIS CATs. PROMIS CATs have great potential for efficiently measuring important patient-centered outcomes in routine clinical care of a wide range of SLE patients.

Measuring pain phenomena after spinal cord injury: Development and psychometric properties of the SCI-QOL Pain Interference and Pain Behavior assessment tools

OBJECTIVE

To develop modern patient-reported outcome measures that assess pain interference and pain behavior after spinal cord injury (SCI).

DESIGN

Grounded-theory based qualitative item development; large-scale item calibration field-testing; confirmatory factor analyses; graded response model item response theory analyses; statistical linking techniques to transform scores to the Patient Reported Outcome Measurement Information System (PROMIS) metric.

SETTING

Five SCI Model Systems centers and one Department of Veterans Affairs medical center in the United States.

PARTICIPANTS

Adults with traumatic SCI.

INTERVENTIONS

N/A.

OUTCOME MEASURES

Spinal Cord Injury - Quality of Life (SCI-QOL) Pain Interference item bank, SCI-QOL Pain Interference short form, and SCI-QOL Pain Behavior scale.

RESULTS

Seven hundred fifty-seven individuals with traumatic SCI completed 58 items addressing various aspects of pain. Items were then separated by whether they assessed pain interference or pain behavior, and poorly functioning items were removed. Confirmatory factor analyses confirmed that each set of items was unidimensional, and item response theory analyses were used to estimate slopes and thresholds for the items. Ultimately, 7 items (4 from PROMIS) comprised the Pain Behavior scale and 25 items (18 from PROMIS) comprised the Pain Interference item bank. Ten of these 25 items were selected to form the Pain Interference short form.

CONCLUSIONS

The SCI-QOL Pain Interference item bank and the SCI-QOL Pain Behavior scale demonstrated robust psychometric properties. The Pain Interference item bank is available as a computer adaptive test or short form for research and clinical applications, and scores are transformed to the PROMIS metric.

Work productivity in systemic sclerosis, its economic burden and association with health-related quality of life

Objective

To evaluate work productivity and its economic burden in SSc patients.

Methods

Consecutive SSc patients enrolled in the Australian Scleroderma Cohort Study were mailed questionnaires assessing employment (Workers' Productivity and Activity Impairment Questionnaire and a custom-made questionnaire) and health-related quality of life (HRQoL) (36-item Short Form Health Survey and Patient-Reported Outcomes Measurement Information System 29). Linear regression methods were used to determine factors associated with work productivity.

Results

Among 476 patients submitting responses, 55.2% <65 years of age were employed. Unemployed patients were older at the time of survey completion (57.1 vs 53.7 years; P < 0.001) and had longer disease duration from first SSc clinical manifestation (16.2 vs 14.9 years; P = 0.01) than employed patients. The mean age at unemployment onset was 13.2 years below the average Australian retirement age. Of those working in the week prior to completing the survey, 16.0% reported missing work (absenteeism) due to their SSc, accounting for 32.9% of their working week. Reduced productivity while at work (presenteeism) accounted for 22% of their working week. Annual costs per patient as a consequence of unemployment and reduced productivity equated to a total of AUD$67 595.40. Factors independently associated with reduced work productivity were presence of synovitis and sicca symptoms, while tertiary education protected against work impairment. Patients with low HRQoL scores also had low work productivity.

Conclusion

SSc is associated with considerable unemployment and reduced productivity, which in turn is associated with a substantial economic burden and poor HRQoL. Raising awareness and identifying modifiable factors are possible ways of reducing this burden.

Health-related quality of life among adults with diverse rare disorders

Background

Twenty-five to 30 million Americans live with a rare disease (RD) and share challenges unique to RD. The majority of research on RDs has focused on etiology, treatment and care, while the limited health-related quality of life (HRQL) research has been restricted to single RDs, small samples, or non-validated measures. This study reports HRQL among adults with diverse RDs, and compares their scores to those of the U.S. population and people with common chronic health conditions.

Methods

We conducted a cross-sectional survey of adults living in the U.S. diagnosed with any RD. Participants were recruited through RD organizations and completed the online survey between December 2016 and May 2017 (n = 1218). HRQL was assessed using the standardized Patient-Reported Outcomes Measurement Information System (PROMIS). RDs were classified into categories defined by Orphanet. Means and 95% confidence intervals were calculated for the main sample and for RD categories and were compared to published U.S. population norms and common chronic disease norms. Intercorrelations were conducted between HRQL, demographics, and RD experiences.

Results

When compared to the norms for the U.S. population and for those with common chronic diseases, mean HRQL scores were significantly poorer across all six PROMIS domains for the main sample, and were usually poorer when analyzed by sub-sets of specific RD classifications. People with rare systemic and rheumatologic, neurological, and immune diseases had the poorest HRQL. Participants had poorer HRQL if they had multiple RDs, lower income, were female, or older. Having symptoms longer was associated with worse HRQL, however, having a formal diagnosis longer was associated with better HRQL.

Conclusions

This study is the first to examine HRQL in a large, heterogeneous sample of RDs using validated measures. There is a significant disparity in HRQL among people with RD compared to the general population and people with common chronic diseases. Poor HRQL could be attributed to challenges accessing diagnoses, medical information, treatment, psychosocial support, and coping with stigma and uncertainty. As most individuals with RDs will not be cured in their lifetimes, identifying ways to improve HRQL is crucial to patient-centered care and should be a funding priority.

Large-scale clinical implementation of PROMIS computer adaptive testing with direct incorporation into the electronic medical record

The objective of this research was to assess the implementation of collecting patient-reported outcomes data in the outpatient clinics of a large academic hospital and identify potential barriers and solutions to such an implementation. Three PROMIS computer adaptive test instruments, (1) physical function, (2) pain interference, and (3) depression, were administered at 23,813 patient encounters using a novel software platform on tablet computers. The average time to complete was 3.50 ± 3.12 min, with a median time of 2.60 min. Registration times for new patients did not change significantly, 6.87 ± 3.34 to 7.19 ± 2.69 min. Registration times increased for follow-up (p = .007) from 2.94 ± 1.57 (p < .01) min to 3.32 ± 1.78 min. This is an effective implementation strategy to collect patient-reported outcomes and directly import the results into the electronic medical record in real time for use during the clinical visit.

Functional disability and other health-related quality-of-life domains: points to consider for clinical trials in systemic sclerosis

Patients with SSc have the highest mortality among the rheumatic diseases. In addition, SSc is associated with disfigurement, hand contractures, fatigue, poor sleep, severe RP with numbness and tingling of the fingers can lead to decrements in quality of life. This Points to Consider article provides practical considerations for design of trials for functional disability and other health-related quality-of-life issues.

Performance of the Patient-Reported Outcomes Measurement Information System-29 in scleroderma: a Scleroderma Patient-centered Intervention Network Cohort Study

Objective

The Patient-Reported Outcomes Measurement Information System (PROMIS)-29 assesses seven health-related quality of life domains plus pain intensity. The objective was to examine PROMIS-29v2 validity and explore clinical associations in patients with SSc.

Methods

English-speaking SSc patients in the Scleroderma Patient-centered Intervention Network Cohort from 26 sites in Canada, the USA and the UK completed the PROMIS-29v2 between July 2014 and November 2015. Enrolling physicians provided medical data. To examine convergent validity, hypotheses on the direction and magnitude of correlations with legacy measures were tested. For clinical associations, t -tests were conducted for dichotomous variables and PROMIS-29v2 domain scores. Effect sizes (ESs) were labelled as small (<0.25), small to moderate (0.25-0.45), moderate (0.46-0.55), moderate to large (0.56-0.75) and large (>0.75).

Results

There were 696 patients (87% female), mean ( s . d .) disease duration 11.6 (8.7) years, 57% with limited cutaneous subtype. Validity indices were consistent with seven of nine hypotheses (| r | =0.51-0.87, P < 0.001), with minor divergence for two hypotheses. Gastrointestinal involvement was associated with significantly worse outcomes for all eight PROMIS-29v2 domains (moderate or moderate to large ES in six of eight). Presence of joint contractures was associated with significant decrements in seven domains (small or small to moderate ESs). Skin thickening, diffuse cutaneous subtype and presence of overlap syndromes were significantly associated (small or small to moderate ESs) with five or six domains.

Conclusion

This study further establishes the validity of the PROMIS-29v2 in SSc and underlines the importance of gastrointestinal symptoms and joint contractures in reduced health-related quality of life.

A telephonic mindfulness-based intervention for persons with sickle cell disease: study protocol for a randomized controlled trial

Background

One of the most difficult symptoms for persons with sickle cell disease (SCD) to manage is chronic pain. Chronic pain impacts approximately one-third of persons with SCD and is associated with increased pain intensity, pain behavior, and frequency and duration of hospital visits. A promising category of nonpharmacological interventions for managing both physical and affective components of pain are mindfulness-based interventions (MBIs).

Methods/design

The primary aim of this study is to conduct a randomized controlled study to evaluate the acceptability and feasibility, as well as to determine the preliminary efficacy, of a telephonic MBI for adults with SCD who have chronic pain. We will enroll 60 adult patients with SCD and chronic pain at an outpatient comprehensive SCD center in the southeastern United States. Patients will be randomized to either an MBI or a wait-listed control group. The MBI group will complete a six-session (60 minutes), telephonically delivered, group-based MBI program. The feasibility, acceptability, and efficacy of the MBI regarding pain catastrophizing will be assessed by administering questionnaires at baseline and weeks 1, 3, and 6. In addition, ten randomly selected MBI participants will complete semistructured interviews to help determine intervention acceptability.

Discussion

In this study protocol, we report detailed methods of the randomized controlled trial. Findings of this study will be useful to determine the acceptability, feasibility, and efficacy of an MBI for persons with SCD and chronic pain.

Trial registration

ClinicalTrials.gov identifier: NCT02394587. Registered on 9 February 2015.

Electronic supplementary material

The online version of this article (doi:10.1186/s13063-017-1948-x) contains supplementary material, which is available to authorized users.

Validity and Reliability of Patient Reported Outcomes Measurement Information System Computerized Adaptive Tests in Systemic Lupus Erythematosus

Objective.

The aims of this study were to assess the construct validity and the test-retest reliability of Patient Reported Outcomes Measurement Information System (PROMIS) computerized adaptive tests (CAT) in patients with systemic lupus erythematosus (SLE).

Methods.

Adults with SLE completed the Medical Outcomes Study Short Form-36, LupusQoL-US version (“legacy instruments”), and 14 selected PROMIS CAT. Using Spearman correlations, PROMIS CAT were compared with similar domains measured with legacy instruments. CAT were also correlated with the Safety of Estrogens in Lupus Erythematosus National Assessment–Systemic Lupus Erythematosus Disease Activity Index (SELENA-SLEDAI) disease activity and the Systemic Lupus International Collaborating Clinics/American College of Rheumatology Damage Index (SDI) scores. Test-retest reliability was evaluated using ICC.

Results.

There were 204 outpatients with SLE enrolled in the study and 162 completed a retest. PROMIS CAT showed good performance characteristics and moderate to strong correlations with similar domains in the 2 legacy instruments (r = −0.49 to 0.86, p < 0.001). However, correlations between PROMIS CAT and the SELENA-SLEDAI disease activity and SDI were generally weak and statistically insignificant. PROMIS CAT test-retest ICC were good to excellent, ranging from 0.72 to 0.88.

Conclusion.

To our knowledge, these data are the first to show that PROMIS CAT are valid and reliable for many SLE-relevant domains. Importantly, PROMIS scores did not correlate well with physician-derived measures. This disconnect between objective signs and symptoms and the subjective patient disease experience underscores the crucial need to integrate patient-reported outcomes into clinical care to ensure optimal disease management.

Validity of the PROMIS-29 in a large Australian cohort of patients with systemic sclerosis

Background

We aimed to evaluate the construct validity of the Patient-Reported Outcomes Measurement Information System 29 (PROMIS-29) in Australian systemic sclerosis (SSc) patients.

Methods

SSc patients, identified through the Australian Scleroderma Cohort Study database, completed two quality-of-life instruments concurrently, the PROMIS-29 and the Medical Outcomes Study 36-Item Short Form Health Survey (SF-36). The construct validity of the PROMIS-29 was assessed by the correlations between the PROMIS-29 and the SF-36 and Health Assessment Questionnaire Disability Index (HAQ-DI). Cronbach's alpha was used to test the internal reliability of all instruments in Australian SSc patients and non-parametric correlation, including Spearman's correlation, was used to test the construct validity of PROMIS-29 against the SF-36 and HAQ-DI.

Results

A total of 477 completed questionnaires were returned, equating to a response rate of 59.6%. The mean (±SD) age of respondents at the time of the survey was 64.1 (±11.1) years. They were predominantly female (87.4%), with limited disease subtype (lcSSc) (77.8%) and long disease duration from onset of first non-Raynaud's phenomenon symptom at the time of survey (10.9 ± 11.1 years). For the correlation analysis between the PROMIS-29 and the legacy instruments, all Spearman correlation coefficients were in the logical direction and highly significant suggesting that the PROMIS-29 is a good alternative to other validated measures of disease burden.

Conclusions

Our study indicates that the PROMIS-29 questionnaire is a valid instrument for measuring health-related quality of life in Australian females with lcSSc of long duration.

A Health-Related Quality-of-Life Measure for Use in Patients with HIV: A Validation Study

In the United States, HIV has evolved from an acute disease to a chronic illness making health-related quality of life a pre-eminent goal for many persons living with HIV (PLWH). There have been a number of HIV-specific quality-of-life instruments developed, but little attention has been paid to the validation of standardized nondisease-specific quality-of-life instruments tailored to PLWH. The goal of this research was to validate the Patient-Reported Outcomes Measurement Information System (PROMIS)-29, a questionnaire that measures health-related quality of life in PLWH. A sample of 1306 PLWH completed an online anonymous survey assessing their symptom experience and health-related quality of life. A subsample of 209 participants completed another questionnaire 30 days later. The subscales of the PROMIS-29 showed high internal consistency reliability (range = 0.87–0.97). The PROMIS-29 detected differences in health-related quality of life in those persons who reported an AIDS diagnosis compared to those who did not report an AIDS diagnosis. The PROMIS-29 has demonstrated reliability, validity, and reproducibility for use in measuring health-related quality of life in PLWH.

Validation of Patient-Reported Outcomes Measurement Information System Short Forms for Use in Childhood-Onset Systemic Lupus Erythematosus

OBJECTIVE

To validate the pediatric Patient-Reported Outcomes Measurement Information System short forms (PROMIS-SFs) in childhood-onset systemic lupus erythematosus (SLE) in a clinical setting.

METHODS

At 3 study visits, childhood-onset SLE patients completed the PROMIS-SFs (anger, anxiety, depressive symptoms, fatigue, physical function-mobility, physical function-upper extremity, pain interference, and peer relationships) using the PROMIS assessment center, and health-related quality of life (HRQoL) legacy measures (Pediatric Quality of Life Inventory, Childhood Health Assessment Questionnaire, Simple Measure of Impact of Lupus Erythematosus in Youngsters [SMILEY], and visual analog scales [VAS] of pain and well-being). Physicians rated childhood-onset SLE activity on a VAS and completed the Systemic Lupus Erythematosus Disease Activity Index 2000. Using a global rating scale of change (GRC) between study visits, physicians rated change of childhood-onset SLE activity (GRC-MD1: better/same/worse) and change of patient overall health (GRC-MD2: better/same/worse). Questionnaire scores were compared in support of validity and responsiveness to change (external standards: GRC-MD1, GRC-MD2).

RESULTS

In this population-based cohort (n = 100) with a mean age of 15.8 years (range 10-20 years), the PROMIS-SFs were completed in less than 5 minutes in a clinical setting. The PROMIS-SF scores correlated at least moderately (Pearson's r ≥ 0.5) with those of legacy HRQoL measures, except for the SMILEY. Measures of childhood-onset SLE activity did not correlate with the PROMIS-SFs. Responsiveness to change of the PROMIS-SFs was supported by path, mixed-model, and correlation analyses.

CONCLUSION

To assess HRQoL in childhood-onset SLE, the PROMIS-SFs demonstrated feasibility, internal consistency, construct validity, and responsiveness to change in a clinical setting.

Health State Utilities and Disease Duration in Systemic Sclerosis: Is There an Association?

OBJECTIVE

Health state utility values (HSUV) are used as weightings to calculate quality-adjusted life years in economic evaluations. Evidence suggests that patients' perceptions of a new diagnosis for a chronic disease, while initially poor, may improve over time. The objective of this study was to examine the association between disease duration and direct HSUV scores in patients with systemic sclerosis (SSc).

METHODS

Our study included patients with SSc from a US SSc center. An interviewer administered direct HSUV techniques including the visual analog scale (VAS), time tradeoff (TTO), and standard gamble (SG). We calculated the Short Form 6D HSUV from the Medical Outcomes Study Short Form-36. Additional clinical and demographic variables were collected.

RESULTS

The mean age of the SSc sample (n = 223) was 51 years (SD 16) with the majority being women (84%). Median disease duration was 5 years (interquartile range 1.5-9). Mean (SD) HSUV scores were 0.67 (0.19) for the VAS, 0.76 (0.28) for the TTO, 0.84 (0.22) for the SG, and 0.65 (0.13) for the SF-6D. In patients with early disease (defined as ≤ 2 yrs, n = 78), the mean HSUV values were 0.64 (VAS), 0.70 (TTO), 0.80 (SG), and 0.63 (SF-6D) versus for those with a longer disease duration: 0.69, 0.79, 0.87, and 0.67, respectively. In multivariate analysis, the SG measure showed a significant and positive association with disease duration measured as a continuous variable and using a threshold of 2 years (p = 0.047 and p = 0.023, respectively).

CONCLUSION

Greater disease duration showed a positive association with a direct measure (SG) of utility elicitation after a period of 2 years.

Quality of care in sickle cell disease: Cross-sectional study and development of a measure for adults reporting on ambulatory and emergency department care

Documented deficiencies in adult sickle cell disease (SCD) care include poor access to knowledgeable providers and inadequate treatment in emergency departments (EDs).The aim of this study was to create patient-reported outcome measures of the quality of ambulatory and ED care for adults with SCD.We developed and pilot tested SCD quality of care questions consistent with Consumer Assessments of Healthcare Providers and Systems surveys. We applied psychometric methods to develop scores and evaluate reliability and validity.The participants of this study were adults with SCD (n = 556)-63% aged 18 to 34 years; 64% female; 64% SCD-SS-at 7 US sites.The measure used was Adult Sickle Cell Quality of Life Measurement information system Quality of Care survey.Most participants (90%) reported at least 1 severe pain episode (pain intensity 7.8 ± 2.3, 0-10 scale) in the past year. Most (81%) chose to manage pain at home rather than the ED, citing negative ED experiences (83%). Using factor analysis, we identified Access, Provider Interaction, and ED Care composites with reliable scores (Cronbach α 0.70-0.83) and construct validity (r = 0.32-0.83 correlations with global care ratings). Compared to general adult Consumer Assessments of Healthcare Providers and Systems scores, adults with SCD had worse care, adjusted for age, education, and general health.Results were consistent with other research reflecting deficiencies in ED care for adults with SCD. The Adult Sickle Cell Quality of Life Measurement Quality of Care measure is a useful self-report measure for documenting and tracking disparities in quality of SCD care.

The Impact of Pain and Itch on Functioning and Health-Related Quality of Life in Systemic Sclerosis: An Exploratory Study

CONTEXT

Pain and itch are common symptoms reported by patients with systemic sclerosis (SSc; scleroderma), which can markedly diminish function and health-related quality of life (HRQL).

OBJECTIVES

The aim of this exploratory study was to examine the impact that pain, itch, and the interaction of both have on function (depressive symptoms, overall disability, fatigue, sleep disturbance) and HRQL in patients with SSc.

METHODS

A total of 964 patients from the Canadian Scleroderma Reserch Group Registry completed questionnaires measuring itch and pain severity, function, and HRQL. Multiple regression analyses were performed to examine the impact that pain, itch, and pain × itch interaction have on each outcome variable while controlling for demographic measures. A P-value of ≤0.01 was required for a difference to be deemed statistically significant.

RESULTS

Our results revealed that patients with SSc who reported higher pain and itch severity were also more likely to have greater depressive symptoms, overall disability, sleep and fatigue problems, even when demographic measures were controlled for (P-values ≤0.001). Similar results were obtained for HRQL, regardless of the domains (P-values ≤0.001). A significant association between pain × itch interaction and sleep (P = 0.002), physical functioning (P = 0.003), and general health (P ≤ 0.001) variables also was found. Further investigation of the nature of the pain × itch interaction showed that the effect of pain severity on outcome variables diminishes as itch severity increases.

CONCLUSION

Both pain and itch appear to have a detrimental impact on functioning and HRQL in patients with SSc, suggesting that more targeted approaches to symptom management are warranted.

Patient-Reported Outcomes in Systemic Lupus Erythematosus

Successful management of complex conditions such as systemic lupus erythematosus (SLE) and comorbid conditions benefit from patient-reported outcomes (PRO). Measuring health-related quality of life with PROs provides SLE patients with an opportunity to participate in their treatment and to facilitate better communication with the multidisciplinary team involved in their care. Health outcomes research has produced well-validated instruments that can be used across diseases; others have been specifically developed for SLE. The use of generic and SLE-specific PROs depends on needs, including population monitoring, treatment decision making, clinical trials research, and for evaluating and comparing the effect of therapies.

Fatigue, patient reported outcomes, and objective measurement of physical activity in systemic lupus erythematosus

OBJECTIVE

Fatigue is a common symptom in systemic lupus erythematosus (SLE), and engaging in physical activity may reduce fatigue. We aimed to characterize relationships between fatigue, other health status measures assessed with the Patient Reported Outcomes Measurement Information System (PROMIS) instruments, and accelerometer-based physical activity measurements in patients with SLE. The internal consistency of each PROMIS measure in our SLE sample was also evaluated.

METHODS

This cross-sectional study analyzed 123 adults with SLE. The primary fatigue outcome was Fatigue Severity Scale score. Secondary outcomes were PROMIS standardized T-scores in seven health status domains. Accelerometers were worn for seven days, and mean daily minutes of light, moderate/vigorous, and bouted (10 minutes) moderate/vigorous physical activity were estimated. Cronbach's alpha was determined for each PROMIS measure to assess internal consistency. Relationships between Fatigue Severity Scale, PROMIS, and physical activity were summarized with Spearman partial correlation coefficients (r), adjusted for average daily accelerometer wear time.

RESULTS

Mean Fatigue Severity Scale score (4.3, SD 1.6) was consistent with clinically relevant levels of fatigue. Greater daily and bouted moderate/vigorous physical activity minutes correlated with lower Mean Fatigue Severity Scale score (r = -0.20, p = 0.03 and r = -0.30, p = 0.0007, respectively). For PROMIS, bouted moderate/vigorous physical activity minutes correlated with less fatigue (r = -0.20, p = 0.03). PROMIS internal consistency was excellent, with Cronbach's alpha > 0.90 for each domain. Mean PROMIS T-scores for fatigue, pain interference, anxiety, sleep disturbance, sleep-related impairment, and physical function were worse than reported for the general US population. More moderate/vigorous physical activity minutes were associated with less pain interference (r = -0.22, p = 0.01). Both light physical activity and moderate/vigorous physical activity minutes correlated with better physical function (r = 0.19, p = 0.04 and r = 0.25, p = 0.006, respectively).

CONCLUSION

More time spent in moderate/vigorous physical activity was associated with less fatigue (Fatigue Severity Scale and PROMIS), less pain interference, and better physical function (PROMIS). PROMIS had excellent internal consistency in our SLE sample, and six of seven PROMIS measures indicated poorer average health status in SLE patients compared with the general US population.

Advances in the Evaluation of Longitudinal Construct Validity of Clinical Outcome Assessments

Historically, the assessment of longitudinal construct validity in the field of psychosocial measurement involved defining hypotheses and calculating correlation coefficients using scores based on 2 measures at 2 or more time points. In the context of patient-reported outcomes, this evolved into sensitivity to change and responsiveness, including the computation of effect size estimates of change, standardized response means, and indices such as Guyatt's statistic. Cross-sectional analyses or analyses based on 2 time points have been the standard practice. Evolving conceptualizations have incorporated more than 2 time points and have included depictions of individual trajectories of change in multiple measures, structural equation models, and mixed modeling techniques. The focus of this article is on methods to evaluate longitudinal construct validity. We describe a sample of these methods and provide considerations and recommendations for designing a thoughtful longitudinal construct validity evaluation of clinical outcome assessments.

Applying the Patient-Reported Outcomes Measurement Information System to Assess Upper Extremity Function among Children with Congenital Hand Differences

BACKGROUND

Few studies have evaluated self-assessment tools among children with congenital hand differences. The authors compared three upper extremity disability instruments with the Patient-Reported Outcomes Measurement Information System (PROMIS) Pediatric Upper Extremity Item Bank.

METHODS

Thirty-three children (aged 6 to 17 years) with congenital hand differences completed the Pediatric Outcomes Data Collection Instrument; the Michigan Hand Outcomes Questionnaire; the Disabilities of the Arm, Shoulder, and Hand questionnaire; and the PROMIS Upper Extremity short form and computerized adaptive test. Hand function was also assessed, and construct validity and feasibility were examined.

RESULTS

PROMIS demonstrated good construct validity. Short form and computerized adaptive test were highly correlated with Disabilities of the Arm, Shoulder, and Hand questionnaire scores (r = 0.80, p < 0.001) and Pediatric Outcomes Data Collection Instrument domains (r = 0.70, p < 0.001). PROMIS was moderately correlated with the Michigan Hand Outcomes Questionnaire (r = 0.40, p < 0.05). PROMIS scores also correlated with grip (r = 0.60, p < 0.001) and pinch strength (r = 0.50, p < 0.001). Compared with the Pediatric Outcomes Data Collection Instrument and the Disabilities of the Arm, Shoulder, and Hand and Michigan Hand Outcomes questionnaires, PROMIS required the least time to complete with fewer children requiring assistance.

CONCLUSION

The Patient-Reported Outcomes Measurement Information System is highly correlated with both functional assessment and self-reported function among children with congenital hand differences.

Quality of life in systemic sclerosis

Systemic sclerosis (SSc) is a chronic multi-system autoimmune disease associated with disability and reduced quality of life. There is no effective treatment or cure to SSc, so it is important improve global health of these patients and reduce morbidity and mortality associated with SSc. It was made a literature review about quality of life in patients with SSc, regarding the several factors that should be considered and evaluated when attending to SSc patients. It was also considered the validated scales and questionnaires used to measure outcomes in patients with SSc. We concluded that it is important to have an interdisciplinary approach to SSc patients considering the patient's cognitive representations of the disease and what they value most like mobility and hand function, pain, fatigue, sleep, depression and body image.

Patient reported outcomes in rheumatoid arthritis clinical trials

Patient reported outcomes (PRO) are at the core of assessing RA treatment response with patient assessments of global health or disease activity, pain, and physical function included in the calculation of American College of Rheumatology (ACR) responses. Progress has been made in assessing PROs that include additional patient-valued aspects of disease in recent RA randomized clinical trials (RCTs), particularly fatigue. Importantly, the National Institute of Health (NIH)--Patient Reported Outcomes Measurement Information System (PROMIS) development of psychometrically advanced generic health measures that span the range of symptoms potentially affected in RA, with high precision across the entire range of a symptom are undergoing additional study in RA and other rheumatologic diseases to establish their construct validity, responsiveness, and clinically meaningful cutoffs. PRO measures that are currently used and widely available can provide important perspectives not captured in composite clinical response criteria with the potential of better informing treatment decisions in clinical practice.