Improved responsiveness and reduced sample size requirements of PROMIS physical function scales with item response theory

The Dutch-Flemish PROMIS Physical Function item bank exhibited strong psychometric properties in patients with chronic pain

OBJECTIVE

The objective of this study was to assess the psychometric properties of the Dutch-Flemish Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function item bank in Dutch patients with chronic pain.

STUDY DESIGN AND SETTING

A bank of 121 items was administered to 1,247 Dutch patients with chronic pain. Unidimensionality was assessed by fitting a one-factor confirmatory factor analysis and evaluating resulting fit statistics. Items were calibrated with the graded response model and its fit was evaluated. Cross-cultural validity was assessed by testing items for differential item functioning (DIF) based on language (Dutch vs. English). Construct validity was evaluated by calculation correlations between scores on the Dutch-Flemish PROMIS Physical Function measure and scores on generic and disease-specific measures.

RESULTS

Results supported the Dutch-Flemish PROMIS Physical Function item bank's unidimensionality (Comparative Fit Index = 0.976, Tucker Lewis Index = 0.976) and model fit. Item thresholds targeted a wide range of physical function construct (threshold-parameters range: -4.2 to 5.6). Cross-cultural validity was good as four items only showed DIF for language and their impact on item scores was minimal. Physical Function scores were strongly associated with scores on all other measures (all correlations ≤ -0.60 as expected).

CONCLUSION

The Dutch-Flemish PROMIS Physical Function item bank exhibited good psychometric properties. Development of a computer adaptive test based on the large bank is warranted.

Varying the item format improved the range of measurement in patient-reported outcome measures assessing physical function

Background

Physical function (PF) is a core patient-reported outcome domain in clinical trials in rheumatic diseases. Frequently used PF measures have ceiling effects, leading to large sample size requirements and low sensitivity to change. In most of these instruments, the response category that indicates the highest PF level is the statement that one is able to perform a given physical activity without any limitations or difficulty. This study investigates whether using an item format with an extended response scale, allowing respondents to state that the performance of an activity is easy or very easy, increases the range of precise measurement of self-reported PF.

Methods

Three five-item PF short forms were constructed from the Patient-Reported Outcomes Measurement Information System (PROMIS®) wave 1 data. All forms included the same physical activities but varied in item stem and response scale: format A (“Are you able to …”; “without any difficulty”/“unable to do”); format B (“Does your health now limit you …”; “not at all”/“cannot do”); format C (“How difficult is it for you to …”; “very easy”/“impossible”). Each short-form item was answered by 2217–2835 subjects. We evaluated unidimensionality and estimated a graded response model for the 15 short-form items and remaining 119 items of the PROMIS PF bank to compare item and test information for the short forms along the PF continuum. We then used simulated data for five groups with different PF levels to illustrate differences in scoring precision between the short forms using different item formats.

Results

Sufficient unidimensionality of all short-form items and the original PF item bank was supported. Compared to formats A and B, format C increased the range of reliable measurement by about 0.5 standard deviations on the positive side of the PF continuum of the sample, provided more item information, and was more useful in distinguishing known groups with above-average functioning.

Conclusions

Using an item format with an extended response scale is an efficient option to increase the measurement range of self-reported physical function without changing the content of the measure or affecting the latent construct of the instrument.

Electronic supplementary material

The online version of this article (doi:10.1186/s13075-017-1273-5) contains supplementary material, which is available to authorized users.

Refining a self-assessment of informatics competency scale using Mokken scaling analysis

Healthcare environments are increasingly implementing health information technology (HIT) and those from various professions must be competent to use HIT in meaningful ways. In addition, HIT has been shown to enable interprofessional approaches to health care. The purpose of this article is to describe the refinement of the Self-Assessment of Nursing Informatics Competencies Scale (SANICS) using analytic techniques based upon item response theory (IRT) and discuss its relevance to interprofessional education and practice. In a sample of 604 nursing students, the 93-item version of SANICS was examined using non-parametric IRT. The iterative modeling procedure included 31 steps comprising: (1) assessing scalability, (2) assessing monotonicity, (3) assessing invariant item ordering, and (4) expert input. SANICS was reduced to an 18-item hierarchical scale with excellent reliability. Fundamental skills for team functioning and shared decision making among team members (e.g. "using monitoring systems appropriately," "describing general systems to support clinical care") had the highest level of difficulty, and "demonstrating basic technology skills" had the lowest difficulty level. Most items reflect informatics competencies relevant to all health professionals. Further, the approaches can be applied to construct a new hierarchical scale or refine an existing scale related to informatics attitudes or competencies for various health professions.

Development of a Computer Adaptive Test for Depression Based on the Dutch-Flemish Version of the PROMIS Item Bank

We developed a Dutch-Flemish version of the patient-reported outcomes measurement information system (PROMIS) adult V1.0 item bank for depression as input for computerized adaptive testing (CAT). As item bank, we used the Dutch-Flemish translation of the original PROMIS item bank (28 items) and additionally translated 28 U.S. depression items that failed to make the final U.S. item bank. Through psychometric analysis of a combined clinical and general population sample ( N = 2,010), 8 added items were removed. With the final item bank, we performed several CAT simulations to assess the efficiency of the extended (48 items) and the original item bank (28 items), using various stopping rules. Both item banks resulted in highly efficient and precise measurement of depression and showed high similarity between the CAT simulation scores and the full item bank scores. We discuss the implications of using each item bank and stopping rule for further CAT development.

Northern Manhattan Hispanic Caregiver Intervention Effectiveness Study: protocol of a pragmatic randomised trial comparing the effectiveness of two established interventions for informal caregivers of persons with dementia

INTRODUCTION

The prevalence of dementia is increasing without a known cure, resulting in an increasing number of informal caregivers. Caring for a person with dementia results in increased stress and depressive symptoms. There are several behavioural interventions designed to alleviate stress and depressive symptoms in caregivers of persons with dementia with evidence of efficacy. Two of the best-known interventions are the New York University Caregiver Intervention (NYUCI) and the Resources for Enhancing Alzheimer's Caregivers Health (REACH). The effectiveness of the NYUCI and REACH has never been compared. There is also a paucity of data on which interventions are more effective in Hispanics in New York City. Thus, we proposed the Northern Manhattan Hispanic Caregiver intervention Effectiveness Study (NHiCE), a pragmatic clinical trial designed to compare the effectiveness of adaptations of the NYUCI and the REACH in informal Hispanic caregivers of persons with dementia in New York City.

METHODS AND ANALYSIS

NHiCE is a 6-month randomised controlled trial comparing the effectiveness of adaptations of the NYUCI and REACH among 200 Hispanic informal adult caregivers of persons with dementia. The planned number of sessions of the NYUCI and REACH are similar. The primary outcome measures are changes from baseline to 6 months in the Zarit Caregiver Burden Scale and Geriatric Depression Scale. Our primary approach to analyses will be intent-to-treat. The primary analyses will use mixed random effects models, and a full information maximum likelihood approach, with sensitivity analyses using generalised estimating equation.

ETHICS AND DISSEMINATION

NHiCE is approved by the Institutional Review Board of Columbia University Medical Center (protocol AAAM5150). A Data Safety Monitoring Board monitors the progress of the study. Dissemination will include reports of the characteristics of the study participants, as well as a report of the results of the clinical trial.

TRIAL REGISTRATION NUMBER

NCT02092987, Pre-results.

Northern Manhattan Hispanic Caregiver Intervention Effectiveness Study: protocol of a pragmatic randomised trial comparing the effectiveness of two established interventions for informal caregivers of persons with dementia

INTRODUCTION

The prevalence of dementia is increasing without a known cure, resulting in an increasing number of informal caregivers. Caring for a person with dementia results in increased stress and depressive symptoms. There are several behavioural interventions designed to alleviate stress and depressive symptoms in caregivers of persons with dementia with evidence of efficacy. Two of the best-known interventions are the New York University Caregiver Intervention (NYUCI) and the Resources for Enhancing Alzheimer's Caregivers Health (REACH). The effectiveness of the NYUCI and REACH has never been compared. There is also a paucity of data on which interventions are more effective in Hispanics in New York City. Thus, we proposed the Northern Manhattan Hispanic Caregiver intervention Effectiveness Study (NHiCE), a pragmatic clinical trial designed to compare the effectiveness of adaptations of the NYUCI and the REACH in informal Hispanic caregivers of persons with dementia in New York City.

METHODS AND ANALYSIS

NHiCE is a 6-month randomised controlled trial comparing the effectiveness of adaptations of the NYUCI and REACH among 200 Hispanic informal adult caregivers of persons with dementia. The planned number of sessions of the NYUCI and REACH are similar. The primary outcome measures are changes from baseline to 6 months in the Zarit Caregiver Burden Scale and Geriatric Depression Scale. Our primary approach to analyses will be intent-to-treat. The primary analyses will use mixed random effects models, and a full information maximum likelihood approach, with sensitivity analyses using generalised estimating equation.

ETHICS AND DISSEMINATION

NHiCE is approved by the Institutional Review Board of Columbia University Medical Center (protocol AAAM5150). A Data Safety Monitoring Board monitors the progress of the study. Dissemination will include reports of the characteristics of the study participants, as well as a report of the results of the clinical trial.

TRIAL REGISTRATION NUMBER

NCT02092987, Pre-results.

Measurement Properties of the Quebec Back Pain Disability Scale in Patients With Nonspecific Low Back Pain: Systematic Review

BACKGROUND

The Quebec Back Pain Disability Scale (QBPDS) has been translated into different languages, and several studies on its measurement properties have been done.

PURPOSE

The purpose of this review was to critically appraise and compare the measurement properties, when possible, of all language versions of the QBPDS by systematically reviewing the methodological quality and results of the available studies.

METHOD

Bibliographic databases (PubMed, Embase, CINAHL, and PsycINFO) were searched for articles with the key words "Quebec," "back," "pain," and "disability" in combination with a methodological search filter for finding studies on measurement properties concerning the development or evaluation of the measurement properties of the QBPDS in patients with nonspecific low back pain. Assessment of the methodological quality was carried out by the reviewers using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist for both the original language version of the QBPDS in English and French and all translated versions. The results of the measurement properties were rated based on criteria proposed by Terwee et al.

RESULTS

The search strategy resulted in identification of 1,436 publications, and 27 articles were included in the systematic review. There was limited-to-moderate evidence of good reliability, validity, and responsiveness of the QBPDS for the different language versions, but for no language version was evidence available for all measurement properties.

CONCLUSION

For research and clinical practice, caution is advised when using the QBPDS to measure disability in patients with nonspecific low back pain. Strong evidence is lacking on all measurement properties for each language version of the QBPDS.

Validity of PROMIS physical function measured in diverse clinical samples

OBJECTIVES

To evaluate the validity of the Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function measures using longitudinal data collected in six chronic health conditions.

STUDY DESIGN AND SETTING

Individuals with rheumatoid arthritis (RA), major depressive disorder (MDD), back pain, chronic obstructive pulmonary disease (COPD), chronic heart failure (CHF), and cancer completed the PROMIS Physical Function computerized adaptive test or fixed-length short form at baseline and at the end of clinically relevant follow-up intervals. Anchor items were also administered to assess change in physical function and general health. Linear mixed-effects models and standardized response means were estimated at baseline and follow-up.

RESULTS

A total of 1,415 individuals participated (COPD n = 121; CHF n = 57; back pain n = 218; MDD n = 196; RA n = 521; cancer n = 302). The PROMIS Physical Function scores improved significantly for treatment of CHF and back pain patients but not for patients with MDD or COPD. Most of the patient subsamples that reported improvement or worsening on the anchors showed a corresponding positive or negative change in PROMIS Physical Function.

CONCLUSION

This study provides evidence that the PROMIS Physical Function measures are sensitive to change in intervention studies where physical function is expected to change and able to distinguish among different clinical samples. The results inform the estimation of meaningful change, enabling comparative effectiveness research.

Patient-Reported Measures of Physical Function in Knee Osteoarthritis

Knee osteoarthritis is a common cause of an array of functional limitations in older adults, and the accurate assessment of such limitations is critical for practicing clinicians and scientists. Patient-reported measures are a valuable resource to track the type and severity of limitation, although the psychometric performance of each instrument should be thoroughly evaluated before adoption. This article reviews the validity, reliability, sensitivity to change, and responsiveness of 3 patient-reported measures of physical function: the Western Ontario and McMaster Universities Osteoarthritis Index, the Knee Injury and Osteoarthritis Outcome Score, and the Patient Reported Outcomes Measurement Information System Physical Function scale.

PROMIS measures of pain, fatigue, negative affect, physical function, and social function demonstrated clinical validity across a range of chronic conditions

OBJECTIVE

To present an overview of a series of studies in which the clinical validity of the National Institutes of Health's Patient Reported Outcome Measurement Information System (NIH; PROMIS) measures was evaluated, by domain, across six clinical populations.

STUDY DESIGN AND SETTING

Approximately 1,500 individuals at baseline and 1,300 at follow-up completed PROMIS measures. The analyses reported in this issue were conducted post hoc, pooling data across six previous studies, and accommodating the different designs of the six, within-condition, parent studies. Changes in T-scores, standardized response means, and effect sizes were calculated in each study. When a parent study design allowed, known groups validity was calculated using a linear mixed model.

RESULTS

The results provide substantial support for the clinical validity of nine PROMIS measures in a range of chronic conditions.

CONCLUSION

The cross-condition focus of the analyses provided a unique and multifaceted perspective on how PROMIS measures function in "real-world" clinical settings and provides external anchors that can support comparative effectiveness research. The current body of clinical validity evidence for the nine PROMIS measures indicates the success of NIH PROMIS in developing measures that are effective across a range of chronic conditions.

Dutch-Flemish translation of nine pediatric item banks from the Patient-Reported Outcomes Measurement Information System (PROMIS)®

PURPOSE

The Patient-Reported Outcomes Measurement Information System (PROMIS(®)) is a new, state-of-the-art assessment system for measuring patient-reported health and well-being of adults and children. It has the potential to be more valid, reliable, and responsive than existing PROMs. The items banks are designed to be self-reported and completed by children aged 8-18 years. The PROMIS items can be administered in short forms or through computerized adaptive testing. This paper describes the translation and cultural adaption of nine PROMIS item banks (151 items) for children in Dutch-Flemish.

METHODS

The translation was performed by FACITtrans using standardized PROMIS methodology and approved by the PROMIS Statistical Center. The translation included four forward translations, two back-translations, three independent reviews (at least two Dutch, one Flemish), and pretesting in 24 children from the Netherlands and Flanders.

RESULTS

For some items, it was necessary to have separate translations for Dutch and Flemish: physical function-mobility (three items), anger (one item), pain interference (two items), and asthma impact (one item). Challenges faced in the translation process included scarcity or overabundance of possible translations, unclear item descriptions, constructs broader/smaller in the target language, difficulties in rank ordering items, differences in unit of measurement, irrelevant items, or differences in performance of activities. By addressing these challenges, acceptable translations were obtained for all items.

CONCLUSION

The Dutch-Flemish PROMIS items are linguistically equivalent to the original USA version. Short forms are now available for use, and entire item banks are ready for cross-cultural validation in the Netherlands and Flanders.

The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) and how to select an outcome measurement instrument

BACKGROUND

COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) is an initiative of an international multidisciplinary team of researchers who aim to improve the selection of outcome measurement instruments both in research and in clinical practice by developing tools for selecting the most appropriate available instrument.

METHOD

In this paper these tools are described, i.e. the COSMIN taxonomy and definition of measurement properties; the COSMIN checklist to evaluate the methodological quality of studies on measurement properties; a search filter for finding studies on measurement properties; a protocol for systematic reviews of outcome measurement instruments; a database of systematic reviews of outcome measurement instruments; and a guideline for selecting outcome measurement instruments for Core Outcome Sets in clinical trials. Currently, we are updating the COSMIN checklist, particularly the standards for content validity studies. Also new standards for studies using Item Response Theory methods will be developed. Additionally, in the future we want to develop standards for studies on the quality of non-patient reported outcome measures, such as clinician-reported outcomes and performance-based outcomes.

CONCLUSIONS

In summary, we plea for more standardization in the use of outcome measurement instruments, for conducting high quality systematic reviews on measurement instruments in which the best available outcome measurement instrument is recommended, and for stopping the use of poor outcome measurement instruments.

Item bank development, calibration and validation for patient-reported outcomes in female urinary incontinence

PURPOSE

Current patient-reported outcomes for female urinary incontinence (UI) are limited by their inability to be tailored. Our objective is to describe the development and field testing of seven item banks designed to measure domains identified as important UI in females (UIf). We also describe the calibration and validation properties of the UIf-item banks, which allow for more efficient computerized adaptive testing (CAT) in the future.

METHODS

The UIf-measures included 168 items covering seven domains: Stress UI (SUI), overactive bladder (OAB), urinary frequency, physical, social and emotional health impact and adaptation. Items underwent rigorous qualitative development and psychometric testing across two sites. Items were calibrated using item response theory and evaluated for internal consistency, construct validity and responsiveness.

RESULTS

A total of 750 women (249 SUI, 249 OAB and 252 mixed UI) participated. Mean age was 55 ± 14 years, and 23 % were Hispanic and 80 % white. In addition to face and content validity, the measures demonstrated good internal consistency (coefficient alpha 0.92-0.98) and unidimensionality. There was evidence for construct validity with moderate-to-strong correlations with the UDI (r's ≥ 0.6) and IIQ (r's = ≥0.6) scales. The measures were responsive to change for SUI treatment (paired t test p < .001, ES range 1.3-2.9; SRM range 1.3-2.5) and OAB treatment (paired t test p < .05 for all domains except social health impact and adaptation, ES range 0.3-1.5, SRM range 0.4-1.0). The measures were responsive based on concurrent changes with the UDI and IIQ (p < 0.05). CAT versions were developed and pilot-tested.

CONCLUSIONS

The UIf-item banks demonstrate good psychometric characteristics and are a sufficiently valid set of customizable tools for measuring UI symptoms and life impact.

Establishing a Common Metric for Physical Function: Linking the HAQ-DI and SF-36 PF Subscale to PROMIS(®) Physical Function

BACKGROUND

Physical function (PF) is a common health concept measured in clinical trials and clinical care. It is measured with different instruments that are not directly comparable, making comparative effectiveness research (CER) challenging when PF is the outcome of interest.

OBJECTIVE

Our goal was to establish a common reporting metric, so that scores on commonly used physical function measures can be converted into PROMIS scores.

DESIGN

Following a single-sample linking design, all participants completed items from the NIH Patient Reported Outcomes Measurement Information System (PROMIS®) Physical Function (PROMIS PF) item bank and at least one other commonly used "legacy" measure: the Health Assessment Questionnaire (HAQ) or the Short Form-36 physical function ten-item PF scale (SF-36 PF). A common metric was created using analyses based on item response theory (IRT), producing score cross-walk tables.

PARTICIPANTS

Participants (N = 733) were part of an internet panel, many of whom reported one or more chronic health conditions.

MAIN MEASURES

PROMIS PF, SF-36 PF, and the HAQ-Disability Index (HAQ-DI).

RESULTS

Our results supported the hypothesis that all three scales measure essentially the same concept. Cross-walk tables for use in CER are therefore justified.

CONCLUSIONS

HAQ-DI and SF-36 PF results can be expressed on the PROMIS PF metric for the purposes of CER and other efforts to compare PF results across studies that utilize any one of these three measures. Clinicians seeking to incorporate PROs into their clinics can collect patient data on any one of these three instruments and estimate the equivalent on the other two.

Reliability and Validity of Selected PROMIS Measures in People with Rheumatoid Arthritis

Purpose

To evaluate the reliability and validity of 11 PROMIS measures to assess symptoms and impacts identified as important by people with rheumatoid arthritis (RA).

Methods

Consecutive patients (N = 177) in an observational study completed PROMIS computer adapted tests (CATs) and a short form (SF) assessing pain, fatigue, physical function, mood, sleep, and participation. We assessed test-test reliability and internal consistency using correlation and Cronbach’s alpha. We assessed convergent validity by examining Pearson correlations between PROMIS measures and existing measures of similar domains and known groups validity by comparing scores across disease activity levels using ANOVA.

Results

Participants were mostly female (82%) and white (83%) with mean (SD) age of 56 (13) years; 24% had ≤ high school, 29% had RA ≤ 5 years with 13% ≤ 2 years, and 22% were disabled. PROMIS Physical Function, Pain Interference and Fatigue instruments correlated moderately to strongly (rho’s ≥ 0.68) with corresponding PROs. Test-retest reliability ranged from .725–.883, and Cronbach’s alpha from .906–.991. A dose-response relationship with disease activity was evident in Physical Function with similar trends in other scales except Anger.

Conclusions

These data provide preliminary evidence of reliability and construct validity of PROMIS CATs to assess RA symptoms and impacts, and feasibility of use in clinical care. PROMIS instruments captured the experiences of RA patients across the broad continuum of RA symptoms and function, especially at low disease activity levels. Future research is needed to evaluate performance in relevant subgroups, assess responsiveness and identify clinically meaningful changes.

Validity and measurement precision of the PROMIS physical function item bank and a content validity-driven 20-item short form in rheumatoid arthritis compared with traditional measures

OBJECTIVE

To evaluate the content validity and measurement properties of the Patient-Reported Outcome Measurement Information System (PROMIS) physical function item bank and a 20-item short form in patients with RA in comparison with the HAQ disability index (HAQ-DI) and 36-item Short Form Health Survey (SF-36) physical functioning scale (PF-10).

METHODS

The content validity of the instruments was evaluated by linking their items to the International Classification of Functioning, Disability and Health (ICF) core set for RA. The measures were administered to 690 RA patients enrolled in the Dutch Rheumatoid Arthritis Monitoring registry. Measurement precision was evaluated using item response theory methods and construct validity was evaluated by correlating physical function scores with other clinical and patient-reported outcome measures.

RESULTS

All 207 health concepts identified in the physical function measures referred to activities that are featured in the ICF. Twenty-three of 26 ICF RA core set domains are featured in the full PROMIS physical function item bank compared with 13 and 8 for the HAQ-DI and PF-10, respectively. As hypothesized, all three physical function instruments were highly intercorrelated (r 0.74-0.84), moderately correlated with disease activity measures (r 0.44-0.63) and weakly correlated with age (rs 0.07-0.14). Item response theory-based analysis revealed that a 20-item PROMIS physical function short form covered a wider range of physical function levels than the HAQ-DI or PF-10.

CONCLUSION

The PROMIS physical function item bank demonstrated excellent measurement properties in RA. A content-driven 20-item short form may be a useful tool for assessing physical function in RA.

Calibration and Validation of the Dutch-Flemish PROMIS Pain Interference Item Bank in Patients with Chronic Pain

The Dutch-Flemish PROMIS Group translated the adult PROMIS Pain Interference item bank into Dutch-Flemish. The aims of the current study were to calibrate the parameters of these items using an item response theory (IRT) model, to evaluate the cross-cultural validity of the Dutch-Flemish translations compared to the original English items, and to evaluate their reliability and construct validity. The 40 items in the bank were completed by 1085 Dutch chronic pain patients. Before calibrating the items, IRT model assumptions were evaluated using confirmatory factor analysis (CFA). Items were calibrated using the graded response model (GRM), an IRT model appropriate for items with more than two response options. To evaluate cross-cultural validity, differential item functioning (DIF) for language (Dutch vs. English) was examined. Reliability was evaluated based on standard errors and Cronbach's alpha. To evaluate construct validity correlations with scores on legacy instruments (e.g., the Disabilities of the Arm, Shoulder and Hand Questionnaire) were calculated. Unidimensionality of the Dutch-Flemish PROMIS Pain Interference item bank was supported by CFA tests of model fit (CFI = 0.986, TLI = 0.986). Furthermore, the data fit the GRM and showed good coverage across the pain interference continuum (threshold-parameters range: -3.04 to 3.44). The Dutch-Flemish PROMIS Pain Interference item bank has good cross-cultural validity (only two out of 40 items showing DIF), good reliability (Cronbach's alpha = 0.98), and good construct validity (Pearson correlations between 0.62 and 0.75). A computer adaptive test (CAT) and Dutch-Flemish PROMIS short forms of the Dutch-Flemish PROMIS Pain Interference item bank can now be developed.

PROMIS Physical Function Computer Adaptive Test Compared With Other Upper Extremity Outcome Measures in the Evaluation of Proximal Humerus Fractures in Patients Older Than 60 Years

OBJECTIVES

To compare the PROMIS Physical Function Computer Adaptive Test (PROMIS PF CAT) to commonly used traditional PF measures for the evaluation of patients with proximal humerus fractures.

DESIGN

Prospective.

SETTING

Two Level I trauma centers.

PATIENTS/PARTICIPANTS

Forty-seven patients older than 60 years with displaced proximal humerus fractures treated between 2006 and 2009.

INTERVENTION

Evaluation included completion of the PROMIS PF CAT, the Constant Shoulder Score, the Disabilities of the Arm, Shoulder, and Hand (DASH) and the Short Musculoskeletal Functional Assessment (SMFA).

MAIN OUTCOME MEASUREMENT

Observed correlations among the administered PF outcome measures.

RESULTS

On average, patients responded to 86 outcome-related items for this study: 4 for the PROMIS PF CAT (range: 4-8 items), 6 for the Constant Shoulder Score, 30 for the DASH, and 46 for the SMFA. Time to complete the PROMIS PF CAT (median completion time = 98 seconds) was significantly less than that for the DASH (median completion time = 336 seconds, P < 0.001) and for the SMFA (median completion time = 482 seconds, P < 0.001). PROMIS PF CAT scores correlated statistically significantly and were of moderate-to-high magnitude with all other PF outcome measure scores administered.

CONCLUSIONS

This study suggests using the PROMIS PF CAT as a sole PF outcome measure can yield an assessment of upper extremity function similar to those provided by traditional PF measures, while substantially reducing patient assessment time.

Validation of the PROMIS physical function measures in a diverse US population-based cohort of cancer patients

PURPOSE

To evaluate the validity of the Patient-Reported Outcomes Measurement Information System (PROMIS) physical function measures in a diverse, population-based cancer sample.

METHODS

Cancer patients 6-13 months post-diagnosis (n = 4840) were recruited for the Measuring Your Health study. Participants were diagnosed between 2010 and 2013 with non-Hodgkin lymphoma or cancers of the colorectum, lung, breast, uterus, cervix, or prostate. Four PROMIS physical function short forms (4a, 6b, 10a, and 16) were evaluated for validity and reliability across age and race-ethnicity groups. Covariates included gender, marital status, education level, cancer site and stage, comorbidities, and functional status.

RESULTS

PROMIS physical function short forms showed high internal consistency (Cronbach's α = 0.92-0.96), convergent validity (fatigue, pain interference, FACT physical well-being all r ≥ 0.68), and discriminant validity (unrelated domains all r ≤ 0.3) across survey short forms, age, and race-ethnicity. Known-group differences by demographic, clinical, and functional characteristics performed as hypothesized. Ceiling effects for higher-functioning individuals were identified on most forms.

CONCLUSIONS

This study provides strong evidence that PROMIS physical function measures are valid and reliable in multiple race-ethnicity and age groups. Researchers selecting specific PROMIS short forms should consider the degree of functional disability in their patient population to ensure that length and content are tailored to limit response burden.

Patient-reported outcomes to initiate a provider-patient dialog for the management of hip and knee osteoarthritis

PURPOSE

Although many treatment guidelines exist for hip and knee osteoarthritis (OA), uptake in clinical practice is typically low. Valid patient-reported outcome measures (PROs) that can be easily used in the clinic could aid implementation and evaluation of treatment recommendations, and the tracking of symptoms and function over time. This project responded to a 2012 Call to Action of the Chronic Osteoarthritis Management Initiative of the United States Bone and Joint Initiative; we aimed to develop a tiered list of recommended PROs that could be feasibly applied in common clinical settings, across four domains of pain, function, fatigue, and sleep.

METHODS

PROs were identified through a focused literature review. Clinicians and researchers with OA expertise evaluated each measure' feasibility for use in routine clinical practice, followed by meaningfulness in assessing OA outcomes. Eligible PROs were categorized by domain and ranked into Tiers One (very brief measures for initial use in clinical settings), Two (brief measures with more in-depth assessment), and Three (most detailed assessment).

RESULTS

Total PROs identified were 172 for pain, 160 for function, 55 for fatigue, and 60 for sleep. Of these, 9 pain, 7 function, 7 fatigue, and 8 sleep PROs were ranked into one of three tiers.

CONCLUSIONS

This three-tiered list of recommended PROs provides a basis for tools to systematically track outcomes, facilitate provider-patient dialog, and guide treatment for hip or knee OA. Research is needed to test the utility and feasibility of systematic implementation of these measures in primary care and specialty clinical settings.

A novel comparative effectiveness study of Tai Chi versus aerobic exercise for fibromyalgia: study protocol for a randomized controlled trial

Background

Fibromyalgia is a chronic musculoskeletal pain syndrome that causes substantial physical and psychological impairment and costs the US healthcare system over $25 billion annually. Current pharmacological therapies may cause serious adverse effects, are expensive, and fail to effectively improve pain and function. Finding new and effective non-pharmacological treatments for fibromyalgia patients is urgently needed. We are currently conducting the first comparative effectiveness randomized trial of Tai Chi versus aerobic exercise (a recommended component of the current standard of care) in a large fibromyalgia population. This article describes the design and conduct of this trial.

Methods/design

A single-center, 52-week, randomized controlled trial of Tai Chi versus aerobic exercise is being conducted at an urban tertiary medical center in Boston, Massachusetts. We plan to recruit 216 patients with fibromyalgia. The study population consists of adults ≥21 years of age with fibromyalgia who meet American College of Rheumatology 1990 and 2010 diagnostic criteria. Participants are randomized to one of four Tai Chi intervention groups: 12 or 24 weeks of supervised Tai Chi held once or twice per week, or a supervised aerobic exercise control held twice per week for 24 weeks. The primary outcome is the change in Revised Fibromyalgia Impact Questionnaire total score from baseline to 24 weeks. Secondary outcomes include measures of widespread pain, symptom severity, functional performance, balance, muscle strength and power, psychological functioning, sleep quality, self-efficacy, durability effects, and health-related quality of life at 12, 24, and 52 week follow-up.

Discussion

This study is the first comparative effectiveness randomized trial of Tai Chi versus aerobic exercise in a large fibromyalgia population with long-term follow up. We present here a robust and well-designed trial to determine the optimal frequency and duration of a supervised Tai Chi intervention with regard to short- and long-term effectiveness. The trial also explores multiple outcomes to elucidate the potential mechanisms of Tai Chi and aerobic exercise and the generalizability of these interventions across instructors. Results of this study are expected to have important public health implications for patients with a major disabling disease that incurs substantial health burdens and economic costs.

Trial registration

ClinicalTrials.gov identifier: NCT01420640, registered 18 August 2011.

Electronic supplementary material

The online version of this article (doi:10.1186/s13063-015-0548-x) contains supplementary material, which is available to authorized users.

The PROMIS physical function correlates with the QuickDASH in patients with upper extremity illness

BACKGROUND

To assess disability more efficiently with less burden on the patient, the National Institutes of Health has developed the Patient Reported Outcomes Measurement Information System (PROMIS) Physical Function-an instrument based on item response theory and using computer adaptive testing (CAT). Initially, upper and lower extremity disabilities were not separated and we were curious if the PROMIS Physical Function CAT could measure upper extremity disability and the Quick Disability of Arm, Shoulder and Hand (QuickDASH).

QUESTIONS/PURPOSES

We aimed to find correlation between the PROMIS Physical Function and the QuickDASH questionnaires in patients with upper extremity illness. Secondarily, we addressed whether the PROMIS Physical Function and QuickDASH correlate with the PROMIS Depression CAT and PROMIS Pain Interference CAT instruments. Finally, we assessed factors associated with QuickDASH and PROMIS Physical Function in multivariable analysis.

METHODS

A cohort of 93 outpatients with upper extremity illnesses completed the QuickDASH and three PROMIS CAT questionnaires: Physical Function, Pain Interference, and Depression. Pain intensity was measured with an 11-point ordinal measure (0-10 numeric rating scale). Correlation between PROMIS Physical Function and the QuickDASH was assessed. Factors that correlated with the PROMIS Physical Function and QuickDASH were assessed in multivariable regression analysis after initial bivariate analysis.

RESULTS

There was a moderate correlation between the PROMIS Physical Function and the QuickDASH questionnaire (r=-0.55, p<0.001). Greater disability as measured with the PROMIS and QuickDASH correlated most strongly with PROMIS Depression (r=-0.35, p<0.001 and r=0.34, p<0.001 respectively) and Pain Interference (r=-0.51, p<0.001 and r=0.74, p<0.001 respectively). The factors accounting for the variability in PROMIS scores are comparable to those for the QuickDASH except that the PROMIS Physical Function is influenced by other pain conditions while the QuickDASH is not.

CONCLUSIONS

The PROMIS Physical Function instrument may be used as an upper extremity disability measure, as it correlates with the QuickDASH questionnaire, and both instruments are influenced most strongly by the degree to which pain interferes with achieving goals.

LEVEL OF EVIDENCE

Level III, diagnostic study. See the Instructions for Authors for a complete description of levels of evidence.

Relative performance of commonly used physical function questionnaires in rheumatoid arthritis and a patient-reported outcomes measurement information system computerized adaptive test

OBJECTIVE

To evaluate and compare the measurement precision and sensitivity to change of the Health Assessment Questionnaire disability index (HAQ DI), the Short Form 36 physical functioning scale (PF-10), and simulated Patient-Reported Outcomes Measurement Information System (PROMIS) physical function computer adaptive tests (CATs) with 5, 10, and 15 items, using item response theory-based simulation studies.

METHODS

The measurement precision of the various physical function instruments was evaluated by calculating root mean square errors (RMSEs) between true physical function levels (latent physical function score) and estimated physical function levels. Measurement precision was evaluated at 9 levels of physical function, with 5,000 simulated response patterns per level. Sensitivity to change was evaluated by the ability of a simple statistical test to detect simulated change scores of small to moderate magnitude (standardized effect sizes 0.20, 0.35, and 0.50).

RESULTS

RMSEs were smaller for the PROMIS physical function 15-item CAT (CAT-15) and CAT-10 than for the HAQ DI and PF-10 across all levels of the latent physical function scale. Only marginal improvement in performance was observed for the CAT-15 compared with the CAT-10, and the CAT-5 performed quite similarly to the HAQ DI and PF-10 across most levels of the latent physical function scale. Substantially improved sensitivity to change was observed for the CAT-10 compared with the HAQ DI and PF-10, particularly in detecting moderate effect sizes.

CONCLUSION

Clearly higher measurement precision was observed for the PROMIS CAT compared with the HAQ DI and PF-10. Higher reliability also translated into lower sample size requirements for detecting changes in clinical status.

Assessing the comparative effectiveness of Tai Chi versus physical therapy for knee osteoarthritis: design and rationale for a randomized trial

Background

Knee osteoarthritis (OA) causes pain and long-term disability with annual healthcare costs exceeding $185 billion in the United States. Few medical remedies effectively influence the course of the disease. Finding effective treatments to maintain function and quality of life in patients with knee OA is one of the national priorities identified by the Institute of Medicine. We are currently conducting the first comparative effectiveness and cost-effectiveness randomized trial of Tai Chi versus a physical-therapy regimen in a sample of patients with symptomatic and radiographically confirmed knee OA. This article describes the design and conduct of this trial.

Methods/Design

A single-center, 52-week, comparative effectiveness randomized controlled trial of Tai Chi versus a standardized physical-therapy regimen is being conducted at an urban tertiary medical center in Boston, Massachusetts. The study population consists of adults ≥ 40 years of age with symptomatic and radiographic knee OA (American College of Rheumatology criteria). Participants are randomly allocated to either 12 weeks of Tai Chi (2x/week) or Physical Therapy (2x/week for 6 weeks, followed by 6 weeks of rigorously monitored home exercise). The primary outcome measure is pain (Western Ontario and McMaster Universities WOMAC) subscale at 12 weeks. Secondary outcomes include WOMAC stkiffness and function domain scores, lower extremity strength and power, functional balance, physical performance tests, psychological and psychosocial functioning, durability effects, health related quality of life, and healthcare utilization at 12, 24 and 52 weeks.

Discussion

This study will be the first randomized comparative-effectiveness and cost-effectiveness trial of Tai Chi versus Physical Therapy in a large symptomatic knee OA population with long-term follow up. We present here a robust and well-designed randomized comparative-effectiveness trial that also explores multiple outcomes to elucidate the potential mechanisms of mind-body effect for a major disabling disease with substantial health burdens and economic costs. Results of this study are expected to have important public health implications for the large and growing population with knee OA.

Trial registration

ClinicalTrials.gov identifier: NCT01258985

Electronic supplementary material

The online version of this article (doi:10.1186/1472-6882-14-333) contains supplementary material, which is available to authorized users.

The Orthopaedic Foot and Ankle Outcomes Research (OFAR) network: feasibility of a multicenter network for patient outcomes assessment in foot and ankle

INTRODUCTION

There is an increasing need for orthopaedic practitioners to measure and collect patient-reported outcomes data. In an effort to better understand outcomes from operative treatment, the American Orthopaedic Foot & Ankle Society (AOFAS) established the Orthopaedic Foot and Ankle Outcomes Research (OFAR) Network, a national consortium of foot and ankle orthopaedic surgeons. We hypothesized that the OFAR Network could successfully collect, aggregate, and report patient-reported outcome (PRO) data using the National Institutes of Health (NIH) Patient Reported Outcomes Measurement Information System (PROMIS).

METHODS

Ten sites enrolled consecutive patients undergoing elective surgery for 1 of 6 foot/ankle disorders. Outcome instruments were collected preoperatively and at 6 months postoperatively using the PROMIS online system: Foot and Ankle Ability Measure (FAAM), Foot Function Index (FFI), and PROMIS physical function (PF) and pain computerized adaptive tests (CAT). During the 3-month period, 328 patients were enrolled; 249 (76%) had completed preoperative patient-reported outcomes data and procedure-specific data. Of these, 140 (56%) also completed 6-month postoperative patient- reported outcomes data.

RESULTS

Ankle arthritis and flatfoot demonstrated consistently worse preoperative scores. Five of 6 disorders showed significant improvement at 6 months on PF CAT and FAAM, 4 of 6 showed improvement on pain interference CAT, and no disorders showed improvement on FFI. Ankle arthritis and flatfoot demonstrated the greatest magnitude of change on most patient-reported outcomes scales.

CONCLUSION

We were able to enroll large numbers of patients in a short enrollment period for this preliminary study. Data were easily aggregated and analyzed. Substantial loss of follow-up data indicates a critical area requiring further effort. The AOFAS OFAR Network is undergoing expansion with goals to ultimately facilitate large, prospective multicenter studies and optimize the quality and interpretation of available outcome instruments for the foot and ankle population.

LEVEL OF EVIDENCE

Level II, prospective comparative study.

Extending the floor and the ceiling for assessment of physical function

OBJECTIVE

To improve the assessment of physical function by enhancing precision of physical function assessment as it pertains to subjects at extreme ends of the health continuum (i.e., subjects with extremely poor function ["floor"] or extremely good health ["ceiling"]).

METHODS

Under the Patient-Reported Outcomes Measurement Information System (PROMIS) (a National Institutes of Health initiative), we developed new items to assess floor and ceiling physical function in order to supplement the existing item bank. Using item response theory and standard PROMIS methodology, we developed 31 floor items and 31 ceiling items and administered the items during a 12-month prospective, observational study of 737 subjects whose health status was at either extreme. Effect size was calculated and change over time was compared across anchor instruments and across items. Using the observed changes in scores, we back-calculated sample size requirements for the new and comparison measures.

RESULTS

We studied 444 subjects who had been diagnosed as having a chronic illness and/or were of old age and 293 generally fit subjects (including athletes in training). Item response theory analyses confirmed that the new floor and ceiling items outperformed reference items (P < 0.001). The estimated post hoc sample size requirements were reduced by a factor of 2-4 for the floor population and a factor of 2 for the ceiling population.

CONCLUSION

Extending the range of items by which physical function is measured can substantially improve measurement quality, reduce sample size requirements, and improve research efficiency. The paradigm shift from assessing disability to assessing physical function focuses assessment on the entire spectrum of physical function, signals improvement in the conceptual base of outcome assessment, and may be transformative as medical goals more closely approach societal goals for health.

PASTOR/PROMIS® pain outcomes system: what does it mean to pain specialists?

SUMMARY 

The Army Pain Management Task Force was charged with recommending pain management strategies for Army Medical Command that would optimize quality of life for patients living with acute and chronic pain. Among their recommendations was the development of the Pain Assessment Screening Tool and Outcomes Registry (PASTOR). In order to develop this tool, the Pain Management Task Force leveraged the NIH's investment in building the Patient-Reported Outcomes Measurement Information System (PROMIS®). The two foci of PASTOR are to enhance the clinical encounter and provide data for comprehensive evaluations of treatment effectiveness. The potential of such information for the future of clinical management is described.

Dutch-Flemish translation of 17 item banks from the patient-reported outcomes measurement information system (PROMIS)

BACKGROUND

The Patient-Reported Outcomes Measurement Information System (PROMIS(®)) is a new, state-of-the-art assessment system for measuring patient-reported health and well-being of adults and children that has the potential to be more valid, reliable and responsive than existing PROMs. The PROMIS items can be administered in short forms or, more efficiently, through computerized adaptive testing. This paper describes the translation of 563 items from 17 PROMIS item banks (domains) for adults from the English source into Dutch-Flemish.

METHODS

The translation was performed by FACITtrans using standardized methodology and approved by the PROMIS Statistical Center. The translation included four forward translations, two back-translations, three to five independent reviews (at least two Dutch, one Flemish) and pre-testing in 70 adults (age range 20-77) from the Netherlands and Flanders.

RESULTS

A small number of items required separate translations for Dutch and Flemish: physical function (five items), pain behaviour (two items), pain interference (one item), social isolation (one item) and global health (one item). Challenges faced in the translation process included: scarcity or overabundance of possible translations, unclear item descriptions, constructs broader/smaller in the target language, difficulties in rank ordering items, differences in unit of measurement, irrelevant items or differences in performance of activities. By addressing these challenges, acceptable translations were obtained for all items.

CONCLUSION

The methodology used and experience gained in this study can be used as an example for researchers in other countries interested in translating PROMIS. The Dutch-Flemish PROMIS items are linguistically equivalent. Short forms will soon be available for use and entire item banks are ready for cross-cultural validation in the Netherlands and Flanders.

OMERACT endorsement of measures of outcome for studies of acute gout

OBJECTIVE

To determine the extent to which participants at the Outcome Measures in Rheumatology (OMERACT) 11 meeting agree that instruments used in clinical trials to measure OMERACT core outcome domains in acute gout fulfill OMERACT filter requirements of truth, discrimination, and feasibility; and where future research efforts need to be directed.

METHODS

Results of a systematic literature review and analysis of individual-level data from recent clinical studies of acute gout were presented to OMERACT participants. The information was discussed in breakout groups, and opinion was defined by subsequent voting in a plenary session. Endorsement was defined as at least 70% of participants voting in agreement with the proposition (where the denominator excluded those participants who did not vote or who voted "don't know").

RESULTS

The following measures were endorsed for use in clinical trials of acute gout: (1) 5-point Likert scale and/or visual analog scale (0 to 100 mm) to measure pain; (2) 4-point Likert scale for joint swelling; (3) 4-point Likert scale for joint tenderness; and (4) 5-point Likert scale for patient global assessment of response to treatment. Measures for the activity limitations domain were not endorsed.

CONCLUSION

Measures of pain, joint swelling, joint tenderness, and patient global assessment in acute gout were endorsed at OMERACT 11. These measures should now be used in clinical trials of acute gout.

Validity and reliability of patient-reported outcomes measurement information system instruments in osteoarthritis

OBJECTIVE

Evaluation of known-group validity, ecological validity, and test-retest reliability of 4 domain instruments from the Patient-Reported Outcomes Measurement Information System (PROMIS) in osteoarthritis (OA) patients.

METHODS

We recruited an OA sample and a comparison general population (GP) sample through an internet survey panel. Pain intensity, pain interference, physical functioning, and fatigue were assessed for 4 consecutive weeks with PROMIS short forms on a daily basis and compared with same-domain Computer Adaptive Testing (CAT) instruments that use a 7-day recall. Known-group validity (comparison of OA and GP), ecological validity (comparison of aggregated daily measures with CAT instruments), and test-retest reliability were evaluated.

RESULTS

The recruited samples matched the demographic characteristics (age, sex, race, and ethnicity) of the US sample for arthritis and the 2009 Census for the GP. Compliance with repeated measurements was excellent at >95%. Known-group validity for CATs was demonstrated with large effect sizes (pain intensity 1.42, pain interference 1.25, and fatigue 0.85). Ecological validity was also established through high correlations between aggregated daily measures and weekly CATs (≥0.86). Test-retest validity (7-day) was very good (≥0.80).

CONCLUSION

PROMIS CAT instruments demonstrated known-group and ecological validity in a comparison of OA patients with a GP sample. Adequate test-retest reliability was also observed. These data provide encouraging initial data on the utility of these PROMIS instruments for clinical and research outcomes in OA patients.

Item response theory, computerized adaptive testing, and PROMIS: assessment of physical function

OBJECTIVE

Patient-reported outcome (PRO) questionnaires record health information directly from research participants because observers may not accurately represent the patient perspective. Patient-reported Outcomes Measurement Information System (PROMIS) is a US National Institutes of Health cooperative group charged with bringing PRO to a new level of precision and standardization across diseases by item development and use of item response theory (IRT).

METHODS

With IRT methods, improved items are calibrated on an underlying concept to form an item bank for a "domain" such as physical function (PF). The most informative items can be combined to construct efficient "instruments" such as 10-item or 20-item PF static forms. Each item is calibrated on the basis of the probability that a given person will respond at a given level, and the ability of the item to discriminate people from one another. Tailored forms may cover any desired level of the domain being measured. Computerized adaptive testing (CAT) selects the best items to sharpen the estimate of a person's functional ability, based on prior responses to earlier questions. PROMIS item banks have been improved with experience from several thousand items, and are calibrated on over 21,000 respondents.

RESULTS

In areas tested to date, PROMIS PF instruments are superior or equal to Health Assessment Questionnaire and Medical Outcome Study Short Form-36 Survey legacy instruments in clarity, translatability, patient importance, reliability, and sensitivity to change.

CONCLUSION

Precise measures, such as PROMIS, efficiently incorporate patient self-report of health into research, potentially reducing research cost by lowering sample size requirements. The advent of routine IRT applications has the potential to transform PRO measurement.

Development and assessment of floor and ceiling items for the PROMIS physical function item bank

Introduction

Disability and Physical Function (PF) outcome assessment has had limited ability to measure functional status at the floor (very poor functional abilities) or the ceiling (very high functional abilities). We sought to identify, develop and evaluate new floor and ceiling items to enable broader and more precise assessment of PF outcomes for the NIH Patient-Reported-Outcomes Measurement Information System (PROMIS).

Methods

We conducted two cross-sectional studies using NIH PROMIS item improvement protocols with expert review, participant survey and focus group methods. In Study 1, respondents with low PF abilities evaluated new floor items, and those with high PF abilities evaluated new ceiling items for clarity, importance and relevance. In Study 2, we compared difficulty ratings of new floor items by low functioning respondents and ceiling items by high functioning respondents to reference PROMIS PF-10 items. We used frequencies, percentages, means and standard deviations to analyze the data.

Results

In Study 1, low (n = 84) and high (n = 90) functioning respondents were mostly White, women, 70 years old, with some college, and disability scores of 0.62 and 0.30. More than 90% of the 31 new floor and 31 new ceiling items were rated as clear, important and relevant, leaving 26 ceiling and 30 floor items for Study 2. Low (n = 246) and high (n = 637) functioning Study 2 respondents were mostly White, women, 70 years old, with some college, and Health Assessment Questionnaire (HAQ) scores of 1.62 and 0.003. Compared to difficulty ratings of reference items, ceiling items were rated to be 10% more to greater than 40% more difficult to do, and floor items were rated to be about 12% to nearly 90% less difficult to do.

Conclusions

These new floor and ceiling items considerably extend the measurable range of physical function at either extreme. They will help improve instrument performance in populations with broad functional ranges and those concentrated at one or the other extreme ends of functioning. Optimal use of these new items will be assisted by computerized adaptive testing (CAT), reducing questionnaire burden and insuring item administration to appropriate individuals.

Use of patient-reported outcome measures in foot and ankle research

BACKGROUND

In the orthopaedic literature, there is a wide range of clinical outcome measurement tools that have been used in evaluating foot and ankle procedures, disorders, and outcomes, with no broadly accepted consensus as to which tools are preferred. The purpose of this study was to determine the frequency and distribution of the various outcome instruments used in the foot and ankle literature, and to identify trends for use of these instruments over time.

METHODS

We conducted a systematic review of all original clinical articles reporting on foot and/or ankle topics in six orthopaedic journals over a ten-year period (2002 to 2011). All clinical patient-reported outcome rating instruments used in these articles were recorded, as were study date, study design, clinical topic, and level of evidence.

RESULTS

A total of 878 clinical foot and ankle articles that used at least one patient-reported outcome measure were identified among 16,513 total articles published during the ten-year period. There were 139 unique clinical outcome scales used, and the five most popular scales (as a percentage of foot/ankle outcome articles) were the American Orthopaedic Foot & Ankle Society (AOFAS) scales (55.9%), visual analog scale (VAS) for pain (22.9%), Short Form-36 (SF-36) Health Survey (13.7%), Foot Function Index (FFI) (5.5%), and American Academy of Orthopaedic Surgeons (AAOS) outcomes instruments (3.3%). The majority of articles described Level-IV studies (70.1%); only 9.4% reported Level-I studies.

CONCLUSIONS

A considerable variety of outcome measurement tools are used in the foot and ankle clinical literature, with a small proportion used consistently. The AOFAS scales continue to be used at a high rate relative to other scales that have been validated. Data from the present study underscore the need for a paradigm shift toward the use of consistent, valid, and reliable outcome measures for studies of foot and ankle procedures and disorders. It is not clear which existing validated outcome instruments will emerge as widely used and clinically meaningful.

CLINICAL RELEVANCE

These data support the need for a paradigm shift toward the consistent use of valid and reliable outcome measures for foot and ankle clinical research.

Advances in Patient-Reported Outcomes: The NIH PROMIS(®) Measures

Patient-reported outcomes (PRO) are questionnaire measures of patients’ symptoms, functioning, and health-related quality of life. They are designed to provide important clinical information that generally cannot be captured with objective medical testing. In 2004, the National Institutes of Health launched a research initiative to improve the clinical research enterprise by developing state-of-the-art PROs. The NIH Patient-Reported Outcomes Measurement System (PROMIS) and Assessment Center are the products of that initiative. Adult, pediatric, and parent-proxy item banks have been developed by using contemporary psychometric methods, yielding rapid, accurate measurements. PROMIS currently provides tools for assessing physical, mental, and social health using short-form and computer-adaptive testing methods. The PROMIS tools are being adopted for use in clinical trials and translational research. They are also being introduced in clinical medicine to assess a broad range of disease outcomes. Recent legislative developments in the United States support greater efforts to include patients’ reports of health experience in order to evaluate treatment outcomes, engage in shared decision-making, and prioritize the focus of treatment. PROs have garnered increased attention by the Food and Drug Administration (FDA) for evaluating drugs and medical devices. Recent calls for comparative effectiveness research favor inclusion of PROs. PROs could also potentially improve quality of care and disease outcomes, provide patient-centered assessment for comparative effectiveness research, and enable a common metric for tracking outcomes across providers and medical systems.

Development of a computer-adaptive version of the forgotten joint score

Patient-reported outcomes (PROs) are an important endpoint in orthopedics providing comprehensive information about patients' perspectives on treatment outcome. Computer-adaptive test (CAT) measures are an advanced method for assessing PROs using item sets that are tailored to the individual patient. This provides increased measurement precision and reduces the number of items. We developed a CAT version of the Forgotten Joint Score (FJS), a measure of joint awareness in everyday life. CAT development was based on FJS data from 580 patients after THA or TKA (808 assessments). The CAT version reduced the number of items by half at comparable measurement precision. In a feasibility study we administered the newly developed CAT measure on tablet PCs and found that patients actually preferred electronic questionnaires over paper-pencil questionnaires.

Factors associated with incomplete DASH questionnaires

BACKGROUND

Missing data are unavoidable in clinical research. Older age, female gender, and fewer years of education are risk factors for missing items in a questionnaire. This study assessed the differences between patients with complete and incomplete Disabilities of the Arms, Shoulder and Hand (DASH) questionnaires in terms of demographics and psychological factors.

METHODS

We analyzed a convenience sample of 1,204 patients enrolled in eight prospective studies. The DASH and the Pain Catastrophizing Scale were completed by all patients. The Center for Epidemiologic Studies Depression scale, Patient Health Questionnaire, Pain Anxiety Symptoms Scale, and an ordinal pain scale were completed by 745, 493, 545, and 391 patients, respectively. Bivariate analysis and binary logistic regression were used to determine risk factors for incomplete (one or more unanswered question) or invalid (more than three unanswered questions) DASH questionnaires.

RESULTS

Thirty-one percent of patients did not complete all questions on the DASH. Patients with an incomplete DASH were older, had fewer years of education, and had higher levels of catastrophic thinking, depression, and pain anxiety. Age and catastrophic thinking were retained in the best logistic regression models of predictors of both incomplete and invalid DASH questionnaires.

CONCLUSIONS

The observation that patients who complete disability questionnaires are different from patients who do not may affect the interpretation of clinical research. Computer adaptive testing may be preferable to avoid incomplete questionnaires.

LEVEL OF EVIDENCE

Prognostic Level II.

Clinical outcomes assessment in clinical trials to assess treatment of femoroacetabular impingement: use of patient-reported outcome measures

Patient-reported outcome measures are an important component of outcomes assessment in clinical trials to assess the treatment of femoroacetabular impingement (FAI). This review of disease-specific measures and instruments used to assess the generic quality of life and physical activity levels of patients with FAI found no conclusive evidence to support a single disease-specific questionnaire. Using a systematic review of study methodology, the Copenhagen Hip and Groin Outcome Score and the 33-item International Hip Outcome Tool scored the best. Nevertheless, both of these instruments were developed recently and have not been established in the literature. Although currently used generic and activity-level measures have limitations, as well, they should be considered, depending on the specific goals of the study. Additional research is needed to assess the properties of these measures fully when used to evaluate patients with FAI.

Universal health outcome measures for older persons with multiple chronic conditions

Older adults with multiple chronic conditions (MCCs) require considerable health services and complex care. Because the persistence and progression of diseases and courses of treatments affect health status in multiple dimensions, well-validated universal outcome measures across diseases are needed for research, clinical care, and administrative purposes. An expert panel meeting held by the National Institute on Aging in September 2011 recommends that older persons with MCCs complete a brief initial composite measure that includes general health; pain; fatigue; and physical health, mental health, and social role function, along with gait speed measurement. Suitable composite measures include the Medical Outcomes Study 8 (SF-8) and 36 (SF-36) -item Short-Form Survey and the Patient Reported Outcomes Measurement Information System 29-item Health Profile. Based on responses to items in the initial measure, short follow-on measures should be selectively targeted to symptom burden, depression, anxiety, and daily activities. Persons unable to walk a short distance to assess gait speed should be assessed using a physical function scale. Remaining gaps to be considered for measure development include disease burden, cognitive function, and caregiver burden. Routine outcome assessment of individuals with MCCs could facilitate system-based care improvement and clinical effectiveness research.

Correlation of the National Institutes of Health patient reported outcomes measurement information system scales and standard pain and functional outcomes in spine augmentation

BACKGROUND AND PURPOSE

The recently developed National Institutes of Health PROMIS initiative provides reliable and valid measures across many health domains. We correlated changes in pain-related PROMIS measures and changes in both an NRS and the RMDI in patients undergoing spine augmentation.

MATERIALS AND METHODS

Fifty patients, composed of 26 women (40-91 years of age; mean, 72.6 years) and 24 men (42-78 years of age, mean, 67.5 years) were enrolled in the study. They were asked at initial presentation and at 30 days to rate the intensity of their pain in the past 24 hours by using a 0-10 pain NRS as well at the 23-item RMDI. Study subjects also completed 3 different PROMIS short forms, including physical function, pain behavior, and pain interference. The Spearman correlation was used to assess the correlation between the scales. The RCI × 1.96 was calculated for each measurement tool as an indicator of change.

RESULTS

All instruments were responsive to detection of change during 1 month (all, P < .0001). Correlations between changes in physical function, pain interference, and pain behavior PROMIS scores and changes in RMDI scores were 0.37, 0.44, and 0.42, respectively. Direction of changes (declines versus improvements) in RMDI and other scales were the same in approximately 60% of patients.

CONCLUSIONS

All measures evaluated had adequate and comparable psychometric properties. The choice of which measure to use depends on the clinical intent of the intervention.

Dutch translation and cross-cultural adaptation of the PROMIS® physical function item bank and cognitive pre-test in Dutch arthritis patients

INTRODUCTION

Patient-reported physical function is an established outcome domain in clinical studies in rheumatology. To overcome the limitations of the current generation of questionnaires, the Patient-Reported Outcomes Measurement Information System (PROMIS®) project in the USA has developed calibrated item banks for measuring several domains of health status in people with a wide range of chronic diseases. The aim of this study was to translate and cross-culturally adapt the PROMIS physical function item bank to the Dutch language and to pretest it in a sample of patients with arthritis.

METHODS

The items of the PROMIS physical function item bank were translated using rigorous forward-backward protocols and the translated version was subsequently cognitively pretested in a sample of Dutch patients with rheumatoid arthritis.

RESULTS

Few issues were encountered in the forward-backward translation. Only 5 of the 124 items to be translated had to be rewritten because of culturally inappropriate content. Subsequent pretesting showed that overall, questions of the Dutch version were understood as they were intended, while only one item required rewriting.

CONCLUSIONS

Results suggest that the translated version of the PROMIS physical function item bank is semantically and conceptually equivalent to the original. Future work will be directed at creating a Dutch-Flemish final version of the item bank to be used in research with Dutch speaking populations.

Measurement properties of physical function scales validated for use in patients with rheumatoid arthritis: a systematic review of the literature

Background

The aim of this study was to systematically review the content validity and measurement properties of all physical function (PF) scales which are currently validated for use with patients with rheumatoid arthritis (RA).

Methods

Systematic literature searches were performed in the Scopus and PubMed databases to identify articles on the development or psychometric evaluation of PF scales for patients with RA. The content validity of included scales was evaluated by linking their items to the International Classification of Functioning Disability and Health (ICF). Furthermore, available evidence of the reliability, validity, responsiveness, and interpretability of the included scales was rated according to published quality criteria.

Results

The search identified 26 questionnaires with PF scales. Ten questionnaires were rated to have adequate content validity. Construct validity, internal consistency, test-retest reliability and responsiveness was rated favourably for respectively 15, 11, 5, and 6 of the investigated scales. Information about the absolute measurement error and minimal important change scores were rarely reported.

Conclusion

Based on this literature review, the disease-specificHAQ and the generic SF-36 can currently be most confidently recommended to measure PF in RA for most research purposes. The HAQ, however, was frequently associated with considerable ceiling effects while the SF-36 has limited content coverage. Alternative scales that might be better suited for specific research purposes are identified along with future directions for research.