Development of a Patient-Reported Outcomes Measurement Information System (PROMIS®) short form for measuring physical function in geriatric rehabilitation patients

Vanderbilt Mini-PROM-Breast for Breast Reconstruction: A Short-Form, Patient-Reported Outcomes Measure

BACKGROUND

Breast reconstruction procedures are among the most commonly performed plastic surgery operations. Although there are well-validated patient-reported outcomes measures (PROMs) for breast reconstruction, there are several patient-, provider-, and service-level barriers to their implementation in routine clinical settings. Therefore, we developed a short-form PROM to evaluate breast reconstruction outcomes.

METHODS

Using a mixed-methods approach, the Vanderbilt Mini-PROM-Breast (VMP-B) was constructed and validated to assess patient-reported outcomes from breast reconstruction. Classic test theory methods were used to evaluate acceptability, reliability, and validity. External validation was subsequently performed using the BREAST-Q as a reference standard.

RESULTS

The VMP-B is a 16-item instrument composed of three domains: quality of life, body image, and breast satisfaction. Psychometric properties including acceptability, reliability, and validity exceeded reference criteria. When tested with 104 patients, the authors found significant benefits of breast reconstruction on quality of life, body image, and breast satisfaction. These results were associated with sizeable effect sizes (g) (g = 0.421, g = 0.520, and g = 1.25) demonstrative of clinically meaningful results. When tested concurrently in 70 patients, the VMP-B and the BREAST-Q showed similar results, exhibiting excellent convergent validity.

CONCLUSIONS

The VMP-B is a validated short-form PROM that reliably assesses breast reconstruction outcomes. As a short form, the VMP-B decreases both patient and provider burden, which allows for routine, point-of-care collection of breast reconstruction outcomes.

Assessment Tools for the Admission of Older Adults to Inpatient Rehabilitation: A Scoping Review

(1) Objective: To identify the assessment tools and outcome measures used to assess older adults for inpatient rehabilitation. (2) Design: Scoping review. (3) Data sources: ProQuest, PEDro, PubMed, CINAHL Plus with full text (EBSCO), Cochrane Library and reference lists from included studies. (4) Review method: The inclusion of studies covering patients aged >60, focusing on rehabilitation assessments delivered in hospitals in community settings. Studies reporting on rehabilitation specifically designed for older adults-testing for at least one domain that affects rehabilitation or assessments for admission to inpatient rehabilitation-were also included. Results were described both quantitatively and narratively. (5) Results: 1404 articles were identified through selected databases and registers, and these articles underwent a filtering process intended to identify and remove any duplicates. This process reduced the number to 1186 articles. These, in turn, were screened for inclusion criteria, as a result of which 37 articles were included in the final review. The majority of assessments for geriatric rehabilitation were carried out by a multidisciplinary team. Multiple studies considered more than one domain during assessment, with a high percentage evaluating a specific outcome measure used in geriatric rehabilitation. The most common domains assessed were function, cognition and medical status-with communication, vision and pain being the least common. A total of 172 outcome measures were identified in this review, with MMSE, BI, FIM and CCI being the most frequent. (6) Conclusions: This review highlights the lack of standardised approaches in existing assessment processes. Generally, older-adult-rehabilitation assessments struggle to capture rehabilitation potential in a holistic manner. Hence, a predictive model of rehabilitation for assessing patients at the initial stages would be useful in planning a patient-specific programme aimed at maximising functional independence and, thus, quality of life.

Orthotic Research Initiative for Outcomes aNalysis (ORION I): predictors of PROMIS PF for stroke survivors seeking orthotic intervention

PURPOSE

Ankle-foot orthoses (AFOs) are used to improve physical performance measures of physical function (PF) post-stroke; however, the perception of improved PF of this population has not been described. The purpose of this study was to identify the predictors of self-reported PF of individuals seeking orthotic intervention post-stroke.

MATERIALS AND METHODS

A retrospective analysis of 237 patients at a nationwide orthotic services provider in the United States was conducted to characterize PF using the Patient-Reported Outcome Measures Information System®. A backward stepwise multiple regression was conducted to identify demographic characteristics predictive of self-reported PF.

RESULTS

The mean T-score of PF of the sample was 30.8 (±6.5), two standard deviations below the US general population mean, indicating significant impairment. The regression model explained approximately 15% (R = 0.411) of the variance in PF of the sample. Self-reported PF was worse for individuals requiring more supportive assistive devices (β = 0.270, p = 0.001), those with more recent ankle problems (β = -0.167, p = 0.035), and those with greater living assistance (β = -0.139, p = 0.089).

CONCLUSIONS

These results improve understanding of the factors that contribute to impaired self-reported PF of stroke survivors in need of AFO intervention.Implications for rehabilitationAnkle-foot orthoses (AFOs) are often used to improve physical performance measures of physical performance (PF) during stroke rehabilitation.Our data indicate that the self-reported PF of AFO users is severely impaired.Level of assistance, time since ankle and foot problems began, and living assistance status are important clinical characteristics to consider when planning AFO intervention for this population.

The patient-reported outcomes measurement information systems (PROMIS®) physical function and its derivative measures in adults: a systematic review of content validity

PURPOSE

This study aims to systematically review and critically appraise the content validity of the adult versions of the Patient-Reported Outcomes Measurement Information System Physical Function (PROMIS-PF) item bank and its derivative measures in any adult population.

METHODS

MEDLINE and EMBASE were searched in October 2021 for studies on measurement properties of PROMIS-PF measures in an adult population. Studies were included if the study described the development of a PROMIS-PF measure or investigated its relevance, comprehensiveness, or comprehensibility. Assessment of the methodological quality of eligible studies, rating of results, and summarizing evidence was performed following the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) methodology for assessing content validity. A modified GRADE approach was used to determine the level of evidence.

RESULTS

Three development studies and eight studies on the content validity of one or more of the PROMIS-PF measures were identified. The methodological quality of most studies was rated doubtful. There was low to high level evidence for sufficient relevance, comprehensiveness, and comprehensibility of most PROMIS-PF measures for healthy seniors and various disease populations. We found low to moderate level evidence for insufficient relevance of PROMIS-PF measures for patients with conditions that affected only one body part, and insufficient comprehensibility of the PROMIS-PF measures for minority elderly.

CONCLUSION

Most PROMIS-PF measures demonstrate sufficient content validity in healthy seniors and various disease populations. However, the quality of this evidence is generally low to moderate, due to limitations in the methodological quality of the studies.

Determining the inter-rater reliability of the SOFMER Activity Score (version 2) for subjects in rehabilitation centers

OBJECTIVES

To assess the inter-rater reliability of the SOFMER Activity Score (SAS, version 2, an 8-item -4 motor and 4 cognitive- and 5-level scale) and improve its scoring system before conducting further validation steps.

DESIGN

Cross-sectional, prospective, observational, non-interventional, and multicentric study.

SETTING

The study was conducted between November 2018 and September 2019 in four French rehabilitation centers (two public university hospitals for adults and two private not-for-profit rehabilitation centers for children).

PARTICIPANTS

The study included 101 subjects (mean age: 44.5 years; SD: 25.4; 28.7% under 18 and 18.8% over 65). The female/male sex ratio was 0.6. The causes for admission to the center were mainly neurological (65%) or orthopedic (24%).

INTERVENTIONS

None.

MAIN OUTCOME MEASURE

Activity limitation was rated with the SOFMER Activity Score the same day by two independent multidisciplinary teams. The inter-rater reliabilities of the Score items were assessed using weighted kappa coefficients.

RESULTS

All weighted kappa coefficients ranged between 0.83 and 0.92 indicating 'good' to 'excellent' inter-rater reliability. Inter-team score disagreements occurred in 227 scores out of 808 (28%). The reason for most disagreements was unnoticed human or material aid during the observation period.

CONCLUSION

The results demonstrate the high inter-rater reliability of the SASv2 and allow carrying out further validation steps after minor changes to item scoring instructions and clearer definitions of some items that help improving scoring standardization. The SASv2 may then become a consistent measure of activity level for clinical research or burden of care investigations.

A Patient-Reported Outcomes Measurement Information System Short Form for Measuring Physical Function During Geriatric Rehabilitation: Test-Retest Reliability, Construct Validity, Responsiveness, and Interpretability

OBJECTIVES

To study the test-retest reliability and measurement error, construct validity, responsiveness, interpretability, and floor/ceiling effects of a Patient-Reported Outcomes Measurement Information System (PROMIS) short form designed to measure physical function in geriatric rehabilitation patients (PROMIS-PF-GR).

DESIGN

Prospective cohort.

SETTING AND PARTICIPANTS

Inpatient geriatric rehabilitation patients.

METHODS

We evaluated the test-retest reliability by re-administering PROMIS-PF-GR 3 to 5 days after the admission measurement. The intraclass correlation coefficient (ICC) was calculated to determine test-retest reliability; an ICC of ≥0.70 was considered sufficient. Measurement error was established by calculating the standard error of measurement and smallest detectable change. Construct validity and responsiveness were determined by testing a priori formulated hypotheses (criterion: ≥75% hypothesis not rejected). Interpretability was evaluated by calculating the minimal important change using predictive modeling and a global rating as criterion for change. Floor/ceiling effects were established by calculating the percentage patients with the minimum/maximum raw score (criterion: ≤15%) at admission and discharge.

RESULTS

A total of 207 patients participated in the study [mean ± standard deviation age (80 ± 8.3 years), 58% female]. More than one-half of patients (56%) reported to be improved during rehabilitation. The ICC was 0.79 (95% confidence interval 0.70-0.84), the standardized error of measurement was 3.8, and the smallest detectable change 10.6. None of the 4 hypotheses for construct validity were rejected; 2 out of 5 hypotheses for responsiveness were rejected. The minimal important change was 8.0 (95% confidence interval 4.1-12.5). No floor/ceiling effects were found.

CONCLUSIONS AND IMPLICATIONS

The PROMIS-PG-GR showed sufficient test-retest reliability, measurement error, and construct validity. We did not find sufficient evidence for responsiveness, which may be due to the unexplained weak correlation between the PROMIS change score and the Global Rating Scale. We still recommend the use the PROMIS-PG-GR for measuring self-reported physical function in geriatric rehabilitation.

Measurement properties of the Dutch-Flemish patient-reported outcomes measurement information system (PROMIS) physical function item bank and instruments: a systematic review

BACKGROUND

Limitations in physical functioning are a big concern especially for patients with chronic or musculoskeletal diseases. Therefore, physical functioning is often used as a core outcome of treatments. The generic patient-reported outcomes information system (PROMIS) physical function (PF) item bank has shown potential to measure PF with better precision, interpretability and lower respondent burden compared with traditional patient-reported outcome measures. This study provides an overview of the current evidence on the quality of the measurement properties of the translated Dutch-Flemish PROMIS-PF item bank and its subdomains, and their derived short forms and computer adaptive tests (CATs).

METHODS

PubMed was searched up to June 17th 2020 for validation studies of Dutch-Flemish PROMIS-PF in Dutch and Flemish adults. Quality assessment of the included studies was conducted using the COSMIN Risk of bias checklist. The COSMIN criteria for good measurement properties were used to judge the results of the studies, which were adjusted and added to where needed for this review, in the context of IRT instruments and item banks. The quality of evidence was summarized for each measurement property based on the Grading of Recommendation Assessment, Development, and Evaluation (GRADE) approach.

RESULTS

Eleven studies were included, evaluating the PROMIS-PF item bank, the Upper Extremity (UE) subdomain, and/or their derived short forms and CATs in different clinical populations. There is evidence for sufficient structural validity, measurement precision, construct validity, and cross-cultural validity of the Dutch-Flemish PROMIS-PF item bank. The upper extremity subdomain item bank shows high quality evidence for structural validity and measurement precision. Content validity of these item banks has not been thoroughly demonstrated in a Dutch-Flemish population. Furthermore, the derived instruments have far less robust evidence: there are fewer validation studies available and none examined their performance as stand-alone administered instruments.

CONCLUSIONS

The first studies into the Dutch-Flemish PROMIS-PF item bank and the UE subdomain show promising results, with especially high quality evidence for sufficient structural validity and measurement precision. However, more studies, and with higher methodological quality, are needed to study the instruments derived from these item banks. These studies should also evaluate content validity, reliability and responsiveness.