A qualitative study investigating the meaning of participation to improve the measurement of this construct

Extending the PROMIS item bank "ability to participate in social roles and activities": a psychometric evaluation using IRT

OBJECTIVE

Our objective was to explore whether the extension of the PROMIS item bank Ability to Participate in Social Roles and Activities (APSRA) with new items would result in more effective targeting (i.e., selecting items that are appropriate for each individual's trait level), and more reliable measurements across all latent trait levels.

METHODS

A sample of 1,022 Dutch adults completed all 35 items of the original item bank plus 17 new items (in Dutch). The new items presented in this publication have been translated provisionally from Dutch into English for presentation purposes. We evaluated the basic IRT assumptions unidimensionality, local independence, and monotonicity. Furthermore, we examined the item parameters, and assessed differential item functioning (DIF) for sex, education, region, age, and ethnicity. In addition, we compared the test information functions, item parameters, and θ scores, for the original and extended item bank in order to assess whether the measurement range had improved.

RESULTS

We found that the extended item bank was compatible with the basic IRT assumptions and showed good reliability. Moreover, the extended item bank improved the measurement in the lower trait range, which is important for reliably assessing functioning in clinical populations (i.e., persons reporting lower levels of participation).

CONCLUSION

We extended the PROMIS-APSRA item bank and improved its psychometric quality. Our study contributes to PROMIS measurement innovation, which allows for the addition of new items to existing item banks, without changing the interpretation of the scores and while maintaining the comparability of the scores with other PROMIS instruments.

Influence of falls, fall-related injuries, and fear of falling on social participation in people aging with long-term physical disability: a cross-sectional study

PURPOSE

This study examined prevalence and relationships among falls, injuries, fear of falling, and social participation in people aging with long-term physical disability (PAwLTPD).

MATERIALS AND METHODS

A convenience sample of 474 PAwLTPD recruited from community agencies and social media as baseline of a longitudinal cohort study. Inclusion criteria: 45-65 years, self-reported physical disability for ≥5 years, and English-speaking. Self-report surveys of physical/mental health, falls in the past year, fear of falling, and Patient-Reported Outcomes Measurement Information System (PROMIS) ability and satisfaction with participation in social roles and activities measures were collected.

RESULTS

Mean age 56.8 years; participants were mostly female (66.7%) and White (61.4%). Nearly 65% reported a fall; 56.6% of falls resulted in injury. Falls and fall-related injuries were associated with worse physical/mental health and presence of >5 health conditions. Seventy-five percent of participants reported fear of falling. Lower ability and satisfaction with participation were found in participants who fell and worried about falls.

CONCLUSIONS

PAwLTPD are at increased risk of falls, fall-related injuries, and fear of falling, which affects their ability to engage in social activities. Future research is needed to understand circumstances associated with falls and to develop effective interventions to address falls in PAwLTPD.

Conceptualization of Participation: A Qualitative Synthesis of Brain Injury Stakeholder Perspectives

Background

The return to participation in meaningful life roles for persons with acquired brain injury (pwABI) is a goal shared by pwABI, their families, clinicians, and researchers. Synthesizing how pwABI define participation will help to identify the aspects of participation important to pwABI and can inform a person-centered approach to participation outcome assessment. To-date, the qualitative synthesis approach has been used to explore facilitators and barriers of participation post-stroke, and views about participation among individuals with stroke in the UK.

Objectives

This paper's objectives are to (1) conduct a scoping review of qualitative literature that defines and characterizes participation from the perspective of pwABI of any type, (2) synthesize how pwABI define and categorize participation, and (3) link the themes identified in the qualitative synthesis to the International Classification of Functioning, Disability, and Health (ICF) using standardized linking rules to enhance the comparability of our findings to other types of health information, including standardized outcome measures.

Methods

We completed a scoping review of qualitative literature. Our search included PubMed, APA PsychInfo, CINAHL, and Embase databases and included articles that (1) had qualitative methodology, (2) had a sample ≥50% pwABI, (3) had aims or research questions related to the meaning, definition, perception, or broader experience of participation, and (4) were in English. Qualitative findings were synthesized using Thomas and Harden's methodology and resultant themes were linked to ICF codes.

Results

The search identified 2,670 articles with 2,580 articles excluded during initial screening. The remaining 90 article abstracts were screened, and 6 articles met the full inclusion criteria for the qualitative synthesis. Four analytical themes emerged: (1) Essential Elements of Participation (2) How pwABI Approach Participation, (3) Where pwABI Participate, and (4) Outcomes of Participation. Each overarching theme included multiple descriptive themes.

Conclusion

In this paper, we identified themes that illustrate key components of participation to pwABI. Our results provide insight into the complex perspectives about participation among pwABI and illustrate aspects of participation that should hold elevated importance for clinicians and researchers supporting participation of pwABI.

Aging with Disability Symptoms and Ability to Participate in, and Satisfaction with, Social Participation among Persons Aged 45–64

Pain, fatigue, and depression, considered aging with disability (AwD) symptoms, are known to be substantially higher among middle-aged adults with long-term disability compared to their age peers. Participation has been recognized as an important component of health. This cohort survey study reports findings on the relationship between AwD symptoms and ability to participate in, and satisfaction with participation in, social roles and activities using PROMIS measures. Data were collected at three time points from individuals aged 45–64 with an average of two decades of disability duration and primarily living in the state of Missouri, USA. This study reports on Time 1 (T1) and Time 3 (T3), pre- and post-COVID-19 pandemic declaration, respectively. Multiple regressions using both individual AwD symptoms and a composite measure demonstrated that having more pain, fatigue, and depression was associated with worse participation outcomes. Lower physical function scores were also related to lower participation scores, as was being female and living with others, and having more income reduced participation. Better physical health and identifying as African American/Black were associated with higher participation scores. Our findings suggest that AwD symptoms, along with other sociodemographic and health factors, play a substantial role in the social participation outcomes for persons aging with disability and remain consistent over time.

Does the global activity limitation indicator measure participation restriction? Data from the European Health and Social Integration Survey in Spain

PURPOSE

The global activity limitation indicator (GALI) is the only internationally agreed and harmonised participation restriction measure. We examine if GALI, as intended, is a reflective measure of the domains of participation; furthermore, we determine the relative importance of these domains. Also, we investigated the consistency of response to GALI by age and gender and compared the performance of GALI with that of self-rated health (SRH).

METHODS

We used Spanish data from the European Health and Social Integration Survey and selected adults aged 18 and over (N = 13,568). Data analysis, based on logistic regression models and Shapley value decomposition, were also stratified by age. The predictors of the models were demographic variables and restrictions in participation domains: studies, work, mobility, leisure and social activities, domestic life, and self-care. The GALI and SRH were the response variables.

RESULTS

GALI was strongly associated with all participation domains (e.g. for domestic life, adjusted OR 24.34 (95% CI 18.53-31.97) in adult under 65) and performed differentially with age (e.g. for domestic life, adjusted OR 13.33 (95% CI 10.42-17.03) in adults over 64), but not with gender. The relative importance of domains varied with age (e.g. work was the most important domain for younger and domestic life for older adults). The results with SRH were parallel to those of GALI, but the association of SRH with participation domains was lowest.

CONCLUSIONS

GALI reflects well restrictions in multiple participation domains and performs differently with age, probably because older people lower their standard of good functioning.

Proposal to extend the PROMIS® item bank v2.0 'Ability to Participate in Social Roles and Activities': item generation and content validity

PURPOSE

Previous research indicated that the Patient-Reported Outcomes Measurement Information System (PROMIS®) item bank v2.0 'Ability to Participate in Social Roles and Activities' may miss subdomains of social participation. The purpose of this study was to generate items for these missing subdomains and to evaluate their content validity.

METHODS

A three-step approach was followed: (1) Item generation for 16 International Classification of Functioning Disability and Health subdomains currently not covered by the item bank; (2) Evaluation of content validity of generated items through expert review (n = 20) and think-aloud interviews with a purposeful sample of people with and without (chronic) health conditions (n = 10), to assess item comprehensibility, relevance, and comprehensiveness; and 3) Item revision based on the results of step 2, in a consensus procedure.

RESULTS

First, 48 items were generated. Second, overall, content experts indicated that the generated items were relevant. Furthermore, based on experts' responses, items were simplified and 'participation in social media' was identified as an important additional subdomain of social participation. Additionally, 'participating in various social roles simultaneously' was identified as a missing item. Based on the responses of the interviewed adults items were simplified. Third, in total 17 items, covering 17 subdomains, were proposed to be added to the original item bank.

DISCUSSION

The relevance, comprehensibility and comprehensiveness of the 17 proposed items were supported. Whether the proposed extension of the item bank leads to better psychometric properties of the item bank should be tested in a large-scale field study.

Changes in the ability to participate in and satisfaction with social roles and activities in patients in outpatient rehabilitation

Background

One of the main aims of rehabilitation is to improve participation. Patient-Reported Outcomes Measurement Information System (PROMIS®) item banks ‘Ability to Participate in Social roles and Activities, (PROMIS-APS) and ‘Satisfaction with Social Roles and Activities’ (PROMIS-SPS) are promising options to measure participation, but the literature on PROMIS measures of (satisfaction with) participation across diagnoses in rehabilitation is limited. Therefore, the objective of this study was to describe levels of and changes in participation, as assessed with the PROMIS-APS and the PROMIS-SPS short forms, of patients in outpatient rehabilitation.

Methods

This study had quantitative, observational design with assessments at admission and discharge. Consecutive patients treated between April and August 2018 receiving outpatient multidisciplinary rehabilitation were the population of this study. The following diagnosis categories were included: brain injury (e.g. stroke), spinal cord and nerve injury, neuromuscular disorder (e.g. lateral sclerosis), amputation, musculoskeletal condition (e.g. osteoarthritis) or heart or lung disease (e.g. myocardial infarction, chronic obstructive pulmonary disease). The main patient-reported outcomes (PRO) of this study were the short form of the PROMIS-APS (8 items, Dutch general population reference score 50.6 [SD 9.5]), and PROMIS-SPS (8 items, Dutch general population reference score 47.5 [SD 8.3].

Results

Of the 1279 patients invited, 777 (61%) completed the online forms at admission. Of those, 329 patients were invited at discharge, with 209 (64%) completing the forms. The mean (SD) T-scores of the PROMIS-APS and PROMIS-SPS were lower at admission (42.7 [SD 7.4]; (41.4 [SD 7.7]) and discharge (43.6 [SD 7.2]; (43.7 [SD 7.8]) than the Dutch general population. The change scores of the PROMIS-APS and PROMIS-SPS were 1.2 (95% CI 0.4–1.9; p = 0.004; effect size 0.16), and 2.4 (95% CI 1.6–3.2; p < 0.0001; effect size 0.31), respectively. In all diagnostic subgroups with > 30 paired measurements statistically significant improvements of PROMIS-APS, PROMIS-SPS or both were seen.

Conclusions

Patients undergoing outpatient rehabilitation had, both at admission and discharge, considerably lower PROMIS-APS and PROMIS-SPS T-scores short forms than the general Dutch population, and showed small T-score improvements at discharge.