The PROMIS-16 reproduces the PROMIS-29 physical and mental health summary scores accurately in a probability-based internet panel

PURPOSE

The Patient-Reported Outcomes Measurement Information System® (PROMIS)-16 assesses the same multi-item domains but does not include the pain intensity item in the PROMIS-29. We evaluate how well physical and mental health summary scores estimated from the PROMIS-16 reproduce those estimated using the PROMIS-29.

METHODS

An evaluation of data collected from 4130 respondents from the KnowledgePanel. Analyses include confirmatory factor analysis to assess physical and mental health latent variables based on PROMIS-16 scores, reliability estimates for the PROMIS measures, mean differences and correlations of scores estimated by the PROMIS-16 with those estimated by the PROMIS-29, and associations between differences in corresponding PROMIS-16 and PROMIS-29 scores by sociodemographic characteristics.

RESULTS

A two-factor (physical and mental health) model adequately fits the PROMIS-16 scores. Reliability estimates for the PROMIS-16 measures were slightly lower than for the PROMIS-29 measures. There were minimal differences between PROMIS physical and mental health summary scores estimated using the PROMIS-16 or the PROMIS-29. PROMIS-16 and PROMIS-29 score differences by sociodemographic characteristics were small. Using the PROMIS pain intensity item when scoring the PROMIS-16 produced similar estimates of physical and mental health summary scores.

CONCLUSION

The PROMIS-16 provides similar estimates of the PROMIS-29 physical and mental health summary scores. The high reliability of these scores indicates they are accurate enough for use with individual patients.

Performance of the Physical Functioning Activities of Daily Living Scale in the 2020 Medicare Health Outcomes Survey

OBJECTIVE

Assessing functional limitations for adults at high risk of frailty yields valuable information for identifying those in need of therapy. We evaluate a self-report measure used to assess physical function among Medicare recipients in the United States.

DESIGN

Secondary analysis of the 2020 Medicare Health Outcomes Survey.

SETTING

A random sample of adult enrollees of 510 managed care plans.

PARTICIPANTS

287,476 adults (37% completion rate): 58% women; 16% were <65 years old (entitled via disability), 50% 65-74, and 34% 75 or older; 77% White, 14% Black, and 8% another race; 19% had

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURE

We evaluate item distributions, dimensionality, monotonicity of response options, reliability, and validity of the 8-item Physical Functioning Activities of Daily Living (PFADL) scale.

RESULTS

Most reported they could do 6 basic activities of daily living without difficulty. More limitations were reported for the other 2 PFADL items: 32% were not limited at all in climbing several flights of stairs and 40% in moderate activities. Product-moment correlations among the 8 items ranged from r=0.19 between the easiest-to-do (eating) and most difficult-to-do (climbing several flights of stairs) items to r=0.73 between bathing and dressing. The coefficient alpha and omega for the 8-item scale were both 0.86. Item slopes ranged from 2.6 (climbing several flights of stairs and eating) to 4.8 (dressing). Item characteristic curves revealed that response options were most likely to be selected in the appropriate order along the physical functioning continuum. The PFADL had at least 0.80 reliability between about -3 SDs below the mean to the mean. It was negatively correlated with comorbid condition count, disability days, problems with balance or walking, falling, and obesity.

CONCLUSIONS

The PFADL is useful for assessing average or below physical function in Medicare recipients.

Collapse

Key Words

• Aged
• Functional status
• Medicare
• Rehabilitation
• Self-assessment

Collapse

MESH Headings

• Adult
• Humans
• Female
• Aged
• United States
• Male
• Activities of Daily Living
• Reproducibility of Results
• Medicare
• Surveys and Questionnaires
• Outcome Assessment, Health Care
• Disability Evaluation

Collapse

Grants Collapse

Affiliation(s)

Ron D Hays UCLA Division of General Internal Medicine, Department of Medicine, Los Angeles, CA.
Marc N Elliott RAND Corporation, Santa Monica, CA

Collapse

Development of short forms for screening children's dental caries and urgent treatment needs using item response theory and machine learning methods

OBJECTIVES

Surveys can assist in screening oral diseases in populations to enhance the early detection of disease and intervention strategies for children in need. This paper aims to develop short forms of child-report and proxy-report survey screening instruments for active dental caries and urgent treatment needs in school-age children.

METHODS

This cross-sectional study recruited 497 distinct dyads of children aged 8-17 and their parents between 2015 to 2019 from 14 dental clinics and private practices in Los Angeles County. We evaluated responses to 88 child-reported and 64 proxy-reported oral health questions to select and calibrate short forms using Item Response Theory. Seven classical Machine Learning algorithms were employed to predict children's active caries and urgent treatment needs using the short forms together with family demographic variables. The candidate algorithms include CatBoost, Logistic Regression, K-Nearest Neighbors (KNN), Naïve Bayes, Neural Network, Random Forest, and Support Vector Machine. Predictive performance was assessed using repeated 5-fold nested cross-validations.

RESULTS

We developed and calibrated four ten-item short forms. Naïve Bayes outperformed other algorithms with the highest median of cross-validated area under the ROC curve. The means of best testing sensitivities and specificities using both child-reported and proxy-reported responses were 0.84 and 0.30 for active caries, and 0.81 and 0.31 for urgent treatment needs respectively. Models incorporating both response types showed a slightly higher predictive accuracy than those relying on either child-reported or proxy-reported responses.

CONCLUSIONS

The combination of Item Response Theory and Machine Learning algorithms yielded potentially useful screening instruments for both active caries and urgent treatment needs of children. The survey screening approach is relatively cost-effective and convenient when dealing with oral health assessment in large populations. Future studies are needed to further leverage the customize and refine the instruments based on the estimated item characteristics for specific subgroups of the populations to enhance predictive accuracy.

Is Primary Care Patient Experience Associated with Provider-Patient Language Concordance and Use of Interpreters for Spanish-preferring Patients: A Systematic Literature Review

BACKGROUND

Healthcare provided by a bilingual provider or with the assistance of an interpreter improves care quality; however, their associations with patient experience are unknown. We reviewed associations of patient experience with provider-patient language concordance (LC) and use of interpreters for Spanish-preferring patients.

METHOD

We reviewed articles from academic databases 2005-2023 following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines and Joanna Briggs Institute Checklists to rate study quality. We reviewed 217 (of 2193) articles, yielding 17 for inclusion.

RESULTS

Of the 17 included articles, most articles focused on primary (n = 6 studies) or pediatric care (n = 5). All were cross-sectional, collecting data by self-administered surveys (n = 7) or interviews (n = 4). Most assessed the relationship between LC or interpreter use and patient experience by cross-sectional associations (n = 13). Two compared subgroups, and two provided descriptive insights into the conversational content (provider-interpreter-patient). None evaluated interventions, so evidence on effective strategies is lacking. LC for Spanish-preferring patients was a mix of null findings (n = 4) and associations with better patient experience (n = 3) (e.g., receiving diet/exercise counseling and better provider communication). Evidence on interpreter use indicated better (n = 2), worse (n = 2), and no association (n = 2) with patient experience. Associations between Spanish-language preference and patient experience were not significant (n = 5) or indicated worse experience (n = 4) (e.g., long waits, problems getting appointments, and not understanding nurses).

CONCLUSION

LC is associated with better patient experience. Using interpreters is associated with better patient experience but only with high-quality interpreters. Strategies are needed to eliminate disparities and enhance communication for all Spanish-preferring primary care patients, whether with a bilingual provider or an interpreter.

Comparison of patient-reported outcomes measurement information system (PROMIS®)-29 and PROMIS global physical and mental health scores

PURPOSE

The Patient-Reported Outcomes Measurement and Information System (PROMIS®): includes the PROMIS-29 physical and mental health summary and the PROMIS global physical and mental health scores. It is unknown how these scores coincide with one another. This study examines whether the scores yield similar or different information.

METHODS

The PROMIS-29 and the PROMIS global health items were administered to 5804 adults from Amazon's Mechanical Turk (MTurk) in 2021-2022 and to 4060 adults in the Ipsos KnowledgePanel (KP) in 2022.

RESULTS

The median age of those in MTurk (KP) was 36 (54) and 53% (50%) were male. Mean T-scores on the PROMIS-29 and PROMIS global physical health scales were similar, but PROMIS global mental health was 3-4 points lower than the PROMIS-29 mental health summary score. Product-moment correlations ranged from 0.69 to 0.81 between the PROMIS-29 physical health and PROMIS global physical health scales and 0.56-0.69 between the mental health scales. Multi-trait multimethod analyses indicated that only a small proportion of the correlations between the two methods of measuring mental health were significantly more highly correlated with one another than correlations between physical and mental health.

CONCLUSIONS

PROMIS-29 and PROMIS global mental health scales provide different information and, therefore, study conclusions may vary depending on which measure is used. Interpretation of results needs to consider that the PROMIS-29 mental health scale is a weighted combination of specific domains while the PROMIS global mental health scale is based on general mental health perceptions. Further comparisons of methods of assessing mental health are needed.

Narrative comments about pediatric inpatient experiences yield substantial information beyond answers to closed-ended CAHPS survey questions

PURPOSE

Adults' comments on patient experience surveys explain variation in provider ratings, with negative comments providing more actionable information than positive comments. We investigate if narrative comments on the Consumer Assessment of Healthcare Providers and Systems (CAHPS®) survey of inpatient pediatric care (Child HCAHPS) account for global perceptions of the hospital beyond that explained by reports about specific aspects of care.

METHODS

We analyzed 545 comments from 927 Child HCAHPS surveys completed by parents and guardians of hospitalized children with at least a 24-h hospital stay from July 2017 to December 2020 at an urban children's hospital. Comments were coded for valence (positive/negative/mixed) and actionability and used to predict Overall Hospital Rating and Willingness to Recommend the Hospital along with Child HCAHPS composite scores.

RESULTS

Comments were provided more often by White and more educated respondents. Negative comments and greater actionability of comments were significantly associated with Child HCAHPS global rating measures, controlling for responses to closed-ended questions, and child and respondent characteristics. Each explained an additional 8% of the variance in respondents' overall hospital ratings and an additional 5% in their willingness to recommend the hospital.

CONCLUSIONS

Child HCAHPS narrative comment data provide significant additional information about what is important to parents and guardians during inpatient pediatric care beyond closed-ended composites.

PRACTICE IMPLICATIONS

Quality improvement efforts should include a review of narrative comments alongside closed-ended responses to help identify ways to improve inpatient care experiences. To promote health equity, comments should be encouraged for racial-and-ethnic minority patients and those with less educational attainment.

Predictors of Pain Management Strategies in Adults with Low-Back Pain: A Secondary Analysis of Amazon Mechanical Turk Survey Data

Objective: To evaluate the associations between baseline demographics, health conditions, pain management strategies, and health-related quality-of-life (HRQoL) measures with pain management strategies at 3-month follow-up in respondents reporting current low-back pain (LBP). Study design: Cohort study of survey data collected from adults with LBP sampled from Amazon Mechanical Turk crowdsourcing panel. Methods: Demographics, health conditions, and the Patient-Reported Outcomes Measurement Information System (PROMIS)-10 were included in the baseline survey. Respondents reporting LBP completed a more comprehensive survey inquiring about pain management strategies and several HRQoL measures. Bivariate then multivariate logistic regression estimated odds ratios (ORs) with 95% confidence intervals (CIs) for the association between baseline characteristics and pain management utilization at 3-month follow-up. Model fit statistics were evaluated to assess the predictive value. Results: The final cohort included 717 respondents with completed surveys. The most prevalent pain management strategy at follow-up was other care (n = 474), followed by no care (n = 94), conservative care only (n = 76), medical care only (n = 51), and medical and conservative care combined (n = 22). The conservative care only group had higher (better) mental and physical health PROMIS-10 scores as opposed to the medical care only and combination care groups, which had lower (worse) physical health scores. In multivariate models, estimated ORs (95% CIs) for the association between baseline and follow-up pain management ranged from 4.6 (2.7-7.8) for conservative care only to 16.8 (6.9-40.7) for medical care only. Additional significant baseline predictors included age, income, education, workman's compensation claim, Oswestry Disability Index score, and Global Chronic Pain Scale grade. Conclusions: This study provides important information regarding the association between patient characteristics, HRQoL measures, and LBP-related pain management utilization.

Development of an ultra-short measure of eight domains of health-related quality of life for research and clinical care: the patient-reported outcomes measurement information system® PROMIS®-16 profile

PURPOSE

We describe development of a short health-related quality of life measure, the patient-reported outcomes measurement information system® (PROMIS®)-16 Profile, which generates domain-specific scores for physical function, ability to participate in social roles and activities, anxiety, depression, sleep disturbance, pain interference, cognitive function, and fatigue.

METHODS

An empirical evaluation of 50 candidate PROMIS items and item pairs was conducted using data from a sample of 5775 respondents from Amazon's Mechanical Turk (MTurk). Results and item response theory information curves for a subset of item pairs were presented and discussed in a stakeholder meeting to narrow the candidate item sets. A survey of the stakeholders and 124 MTurk adults was conducted to solicit preferences among remaining candidate items and finalize the measure.

RESULTS

Empirical evaluation showed minimal differences in basic descriptive statistics (e.g., means, correlations) and associations with the PROMIS-29 + 2 Profile, thus item pairs were further considered primarily based on item properties and content. Stakeholders discussed and identified subsets of candidate item pairs for six domains, and final item pairs were agreed upon for two domains. Final items were selected based on stakeholder and MTurk-respondent preferences. The PROMIS-16 profile generates eight domain scores with strong psychometric properties.

CONCLUSION

The PROMIS-16 Profile provides an attractive brief measure of eight distinct domains of health-related quality of life, representing an ideal screening tool for clinical care, which can help clinicians quickly identify distinct areas of concern that may require further assessment and follow-up. Further research is needed to confirm and extend these findings.

How Well Do Seven Self-Report Measures Represent Underlying Back Pain Impact?

BACKGROUND

The extent to which different measures of back pain impact represent an underlying common factor has implications for decisions about which one to use in studies of pain management and estimating one score from others.

AIMS

To determine if different self-report back pain impact measures represent an underlying pain latent variable and estimate associations with it.

METHOD

Seven pain impact measures completed by Amazon Mechanical Turk adults are used to estimate internal consistency reliability and associations: Oswestry Disability Index (ODI), Roland-Morris Disability Questionnaire (RMDQ), short form of the Örebro Musculoskeletal Pain Questionnaire (OMPQ), Subgroups for Targeted Treatment (STarT) Back Tool, the Graded Chronic Pain Scale (GCPS) disability score, PEG (Pain intensity, interference with Enjoyment of life, interference with General activity), and Impact Stratification Score (ISS).

RESULTS

The sample of 1,874 adults with back pain had an average age of 41 and 52% were female. Sixteen percent were Hispanic, 7% non-Hispanic Black, 5% non-Hispanic Asian, and 71% non-Hispanic White. Internal consistency reliability estimates ranged from 0.710 (OMPQ) to 0.923 (GCPS). Correlations among the measures ranged from 0.609 (RMDQ with OMPQ) to 0.812 (PEG with GCPS). Standardized factor loadings on the pain latent variable ranged from 0.782 (RMDQ) to 0.870 (ISS).

CONCLUSIONS

Scores of each measure can be estimated from the others for use in research.

Associations of Primary Care Provider Burnout with Quality Improvement, Patient Experience Measurement, Clinic Culture, and Job Satisfaction

BACKGROUND

Burnout among providers negatively impacts patient care experiences and safety. Providers at Federally Qualified Health Centers (FQHC) are at high risk for burnout due to high patient volumes; inadequate staffing; and balancing the demands of patients, families, and team members.

OBJECTIVE

Examine associations of provider burnout with their perspectives on quality improvement (QI), patient experience measurement, clinic culture, and job satisfaction.

DESIGN

We conducted a cross-sectional provider survey about their perspectives including the single-item burnout measure. We fit separate regression models, controlling for provider type, gender, being multilingual, and fixed effects for clinic predicting outcome measures from burnout.

PARTICIPANTS

Seventy-four providers from 44 clinics in large, urban FQHC (52% response rate; n = 174).

MAIN MEASURES

Survey included a single-item, self-defined burnout measure adapted from the Physician Worklife Survey, and measures from the RAND AMA Study survey, Heath Tracking Physician survey, TransforMed Clinician and Staff Questionnaire, Physician Worklife Survey, Minimizing Errors Maximizing Outcomes survey, and surveys by Friedberg et al. 31 and Walling et al. 32 RESULTS: Thirty percent of providers reported burnout. Providers in clinics with more facilitative leadership reported not being burned out (compared to those reporting burnout; p-values < 0.05). More pressures related to patient care and lower job satisfaction were associated with burnout (p-values < 0.05).

CONCLUSIONS

Creating provider-team relationships and environments where providers have the time and space necessary to discuss changes to improve care, ideas are shared, leadership supports QI, and QI is monitored and discussed were related to not being burned out. Reducing time pressures and improving support needed for providers to address the high-need levels of FQHC patients can also decrease burnout. Such leadership and support to improving care may be a separate protective factor against burnout. Research is needed to further examine which aspects of leadership drive down burnout and increase provider involvement in change efforts and improving care.

Mapping of the PROMIS global health measure to the PROPr in the United States

BACKGROUND

The Patient-Reported Outcomes Measurement and Information System (PROMIS®) global health items (global-10) yield physical and mental health scale scores and the PROMIS-Preference (PROPr) scoring system estimated from PROMIS domain scores (e.g., PROMIS-29 + 2) produces a single score anchored by 0 (dead or as bad as being dead) to 1 (full health). A link between the PROMIS global-10 and the PROPr is needed.

METHODS

The PROMIS-29 + 2 and the PROMIS global-10 were administered to 4102 adults in the Ipsos KnowledgePanel in 2022. The median age was 52 (range 18-94), 50% were female, 70% were non-Hispanic White, and 64% were married or living with a partner. The highest level of education completed for 26% of the sample was a high school degree or general education diploma and 44% worked full-time. We estimated correlations of the PROPr with the PROMIS global health items and the global physical and mental health scales. We examined the adjusted R2 and estimated correlations between predicted and observed PROPr scores.

RESULTS

Product-moment correlations between the PROMIS global health items and the PROPr ranged from 0.50 to 0.63. The PROMIS global physical health and mental health scale scores correlated 0.74 and 0.60, respectively, with the PROPr. The adjusted R2 in the regression of the PROPr on the PROMIS global health items was 64%. The equated PROPr preference scores correlated (product-moment) 0.80 (n = 4043; p < 0.0001) with the observed PROPr preference scores, and the intra-class correlation (two-way random effects model) was 0.80. The normalized mean absolute error (NMAE) was 0.45 (SD = 0.43). The adjusted R2 in the OLS regression of the PROPr on the PROMIS global health scales was 59%. The equated PROPr preference scores correlated (product-moment) was 0.77 (n = 4046; p < 0.0001) with the observed PROPr preference scores, and the intra-class correlation was 0.77. The NMAE was 0.49 (SD = 0.45).

CONCLUSIONS

Regression equations provide a reasonably accurate estimate of the PROPr preference-based score from the PROMIS global health items or scales for group-level comparisons. These estimates facilitate cost-effectiveness research and meta-analyses. The estimated PROPr scores are not accurate enough for individual-level applications. Future evaluations of the prediction equations are needed.

Estimating individual health-related quality of life changes in low back pain patients

BACKGROUND

There is a need to evaluate different options for estimating individual change in health-related quality of life for patients with low back pain.

METHODS

Secondary analysis of data collected at baseline and 6 weeks later in a randomized trial of 749 adults with low back pain receiving usual medical care (UMC) or UMC plus chiropractic care at a small hospital at a military training site or two large military medical centers. The mean age was 31; 76% were male and 67% were White. The study participants completed the Patient-Reported Outcomes Measurement Information System (PROMIS®)-29 v 1.0 physical function, pain interference, pain intensity, fatigue, sleep disturbance, depression, anxiety, satisfaction with participation in social roles, physical summary, and mental health summary scores (T-scored with mean = 50 and standard deviation (SD) = 10 in the U.S. general population).

RESULTS

Reliability estimates at the baseline ranged from 0.700 to 0.969. Six-week test-retest intraclass correlation estimates were substantially lower than these estimates: the median test-retest intraclass correlation for the two-way mixed-effects model was 0. 532. Restricting the test-retest reliability estimates to the subset who reported they were about the same as at baseline on a retrospective rating of change item increased the median test-retest reliability to 0.686. The amount of individual change that was statistically significant varied by how reliability was estimated, and which SD was used. The smallest change needed was found when internal consistency reliability and the SD at baseline were used. When these values were used, the amount of change needed to be statistically significant (p < .05) at the individual level ranged from 3.33 (mental health summary scale) to 12.30 (pain intensity item) T-score points.

CONCLUSIONS

We recommend that in research studies estimates of the magnitude of individual change needed for statistical significance be provided for multiple reliability and standard deviation estimates. Whenever possible, patients should be classified based on whether they 1) improved significantly and perceived they got better, 2) improved significantly but did not perceive they were better, 3) did not improve significantly but felt they got better, or 4) did not improve significantly or report getting better.

Embedding research study recruitment within the patient portal preCheck-in

OBJECTIVE

Patient portals are increasingly used to recruit patients in research studies, but communication response rates remain low without tactics such as financial incentives or manual outreach. We evaluated a new method of study enrollment by embedding a study information sheet and HIPAA authorization form (HAF) into the patient portal preCheck-in (where patients report basic information like allergies).

MATERIALS AND METHODS

Eligible patients who enrolled received an after-visit patient-reported outcomes survey through the patient portal. No additional recruitment/messaging efforts were made.

RESULTS

A total of 386 of 843 patients completed preCheck-in, 308 of whom signed the HAF and enrolled in the study (37% enrollment rate). Of 93 patients who were eligible to receive the after-visit survey, 45 completed it (48% completion rate).

CONCLUSION

Enrollment and survey completion rates were higher than what is typically seen with recruitment by patient portal messaging, suggesting that preCheck-in recruitment can enhance research study recruitment and warrants further investigation.

Dynamic Risk Prediction of Treatment Discontinuation Using Patient-Reported Outcomes Data in the Phase III NSABP B-35 Trial

Predicting an individual's risk of treatment discontinuation is critical for the implementation of precision chemoprevention. We developed partly conditional survival models to predict discontinuation of tamoxifen or anastrozole using patient-reported outcome (PRO) data from postmenopausal women with ductal carcinoma in situ enrolled in the NSABP B-35 clinical trial. In a secondary analysis of the NSABP B-35 clinical trial PRO data, we proposed two models for treatment discontinuation within each treatment arm (anastrozole or tamoxifen treated patients) using partly conditional Cox-type models with time-dependent covariates. A 70/30 split of the sample was used for the training and validation datasets. The predictive performance of the models was evaluated using calibration and discrimination measures based on the Brier score and AUC from time-dependent ROC curves. The predictive models stratified high-risk versus low-risk early discontinuation at a 6-month horizon. For anastrozole-treated patients, predictive factors included baseline body mass index (BMI) and longitudinal patient-reported symptoms such as insomnia, joint pain, hot flashes, headaches, gynecologic symptoms, and vaginal discharge, all collected up to 12 months [Brier score, 0.039; AUC, 0.76; 95% confidence interval (CI), 0.57-0.95]. As for tamoxifen-treated patients, predictive factors included baseline BMI, and time-dependent covariates: cognitive problems, feelings of happiness, calmness, weight problems, and pain (Brier score, 0.032; AUC, 0.78; 95% CI, 0.65-0.91). A real-time calculator based on these models was developed in Shiny to create a web-based application with a future goal to aid healthcare professionals in decision-making.

PREVENTION RELEVANCE

The dynamic prediction provided by partly conditional models offers valuable insights into the treatment discontinuation risks using PRO data collected over time from clinical trial participants. This tool may benefit healthcare professionals in identifying patients at high risk of premature treatment discontinuation and support interventions to prevent potential discontinuation.

Health-related quality of life in a systematically assessed cohort of children and adults with urea cycle disorders

PURPOSE

Individuals with urea cycle disorders (UCDs) may develop recurrent hyperammonemia, episodic encephalopathy, and neurological sequelae which can impact Health-related Quality of Life (HRQoL). To date, there have been no systematic studies of HRQoL in people with UCDs.

METHODS

We reviewed HRQoL and clinical data for 190 children and 203 adults enrolled in a multicenter UCD natural history study. Physical and psychosocial HRQoL in people with UCDs were compared to HRQoL in healthy people and people with phenylketonuria (PKU) and diabetes mellitus. We assessed relationships between HRQoL, UCD diagnosis, and disease severity. Finally, we calculated sample sizes required to detect changes in these HRQoL measures.

RESULTS

Individuals with UCDs demonstrated worse physical and psychosocial HRQoL than their healthy peers and peers with PKU and diabetes. In children, HRQoL scores did not differ by diagnosis or severity. In adults, individuals with decreased severity had worse psychosocial HRQoL. Finally, we show that a large number of individuals would be required in clinical trials to detect differences in HRQoL in UCDs.

CONCLUSION

Individuals with UCDs have worse HRQoL compared to healthy individuals and those with PKU and diabetes. Future work should focus on the impact of liver transplantation and other clinical variables on HRQoL in UCDs.

Classifying patients with non-specific chronic low back pain using the impact stratification score in an online convenience sample

BACKGROUND

In 2014, the National Institute of Health Pain Consortium's research task force (RTF) on research standards for chronic low back pain (CLBP) proposed the Impact Stratification Score (ISS) as a patient-reported outcome measure that could stratify patients by the impact CLBP has on their lives. This work compares three newly developed ISS-based classifications to the RTF's original to provide an optimal recommendation.

METHODS

The online sample included 1226 individuals from Amazon's Mechanical Turk who indicated having non-specific CLBP, average age of 40, 49% female, and 67% White. Participants completed the PROMIS-29 v2.1 profile survey that contains the 9 ISS items as well the Roland-Morris Disability Questionnaire (RMDQ) and Graded Chronic Pain Scale (GCPS). Other items included high-impact chronic pain; not working due to health problems; overall health; and number of healthcare visits for back pain in the past 6 months. Three new classifications were created using quartiles (Classification 2), latent profile analysis (Classification 3), and one modeled after the GCPS (Classification 4). Classifications were subsequently compared to the RTF-proposed classification (Classification 1) on several concurrent and prognostic criteria.

RESULTS

Classification 1 had three CLBP severity groups, four in Classification 2, three in Classification 3, and four in Classification 4. All novel classifications improved upon the original. Classification 2 performed best at minimizing the classification of those with negative outcomes into the lowest severity groups at baseline (e.g., 11% with RMDQ ≥ 7) and 6 months (e.g., 8.2% had fair/poor health). Classification 4 performed best at maximizing classification of those with negative outcomes into the most severe group concurrently (e.g., 100% had GCPS grade ≥ 2) and at 6 months (e.g., 100% with RMDQ ≥ 7).

CONCLUSIONS

We developed three ISS-based classification schemes and tested them against several outcomes. All three improved upon the original scheme. While appearing more optimal than other classifications in the lowest severity groups, Classification 2 presents some considerations and limitations. Given that Classification 4 was an improvement at the lowest end of severity and was the best at the highest end, it is our tentative recommendation that this approach be adopted to classify individuals with non-specific CLBP.

Support for Use of Consumer Assessment of Healthcare Providers and Systems Communication Items Among Seriously Ill Patients

Background: High-quality doctor-patient communication is essential for patients with serious illnesses. The reliability and validity of Consumer Assessment of Healthcare Providers and Systems (CAHPS®) communication items among these patients are unknown. Methods: Five CAHPS communication items, a 4-item Advance Care Planning (ACP) engagement scale, 5-item confidence in others' knowledge of ACP medical wishes scale, and a question about confidence in filling out ACP-related medical forms were administered to 1100 patients (20% response rate) with serious illness receiving primary care at three University of California Health Systems. Results: Average age was 69 (range 22-102); 52% male, 18% Hispanic, 9% Asian, and 7% Black; 24% had high school or less education. Eigenvalues and internal consistency reliability (0.88) supported a 5-item communication scale. Item characteristic curves showed a monotonic relationship of response options with the communication score. Item thresholds indicated that most patients reported positive patient experiences (i.e., items were negatively skewed). Item slopes ranging from 2.52 to 5.10 confirmed that all items were strongly related to the communication score. Information (reliability) of the communication scale was higher for assessing patients with negative experiences of care than for the positive end of the spectrum. Communication was positively correlated with confidence in other's knowledge of ACP medical wishes (r = 0.32, p < 0.0001), ACP engagement (r = 0.14, p < 0.0001), and confidence in filling out ACP-related medical forms (r = 0.09, p = 0.0022). Conclusions: These findings support the use of CAHPS survey items to assess communication among patients with serious illnesses in primary care. Clinical Trial Registration: https://clinicaltrials.gov/ct2/show/NCT04012749.

Effects of Excluding Those Who Report Having "Syndomitis" or "Chekalism" on Data Quality: Longitudinal Health Survey of a Sample From Amazon's Mechanical Turk

BACKGROUND

Researchers have implemented multiple approaches to increase data quality from existing web-based panels such as Amazon's Mechanical Turk (MTurk).

OBJECTIVE

This study extends prior work by examining improvements in data quality and effects on mean estimates of health status by excluding respondents who endorse 1 or both of 2 fake health conditions ("Syndomitis" and "Chekalism").

METHODS

Survey data were collected in 2021 at baseline and 3 months later from MTurk study participants, aged 18 years or older, with an internet protocol address in the United States, and who had completed a minimum of 500 previous MTurk "human intelligence tasks." We included questions about demographic characteristics, health conditions (including the 2 fake conditions), and the Patient Reported Outcomes Measurement Information System (PROMIS)-29+2 (version 2.1) preference-based score survey. The 3-month follow-up survey was only administered to those who reported having back pain and did not endorse a fake condition at baseline.

RESULTS

In total, 15% (996/6832) of the sample endorsed at least 1 of the 2 fake conditions at baseline. Those who endorsed a fake condition at baseline were more likely to identify as male, non-White, younger, report more health conditions, and take longer to complete the survey than those who did not endorse a fake condition. They also had substantially lower internal consistency reliability on the PROMIS-29+2 scales than those who did not endorse a fake condition: physical function (0.69 vs 0.89), pain interference (0.80 vs 0.94), fatigue (0.80 vs 0.92), depression (0.78 vs 0.92), anxiety (0.78 vs 0.90), sleep disturbance (-0.27 vs 0.84), ability to participate in social roles and activities (0.77 vs 0.92), and cognitive function (0.65 vs 0.77). The lack of reliability of the sleep disturbance scale for those endorsing a fake condition was because it includes both positively and negatively worded items. Those who reported a fake condition reported significantly worse self-reported health scores (except for sleep disturbance) than those who did not endorse a fake condition. Excluding those who endorsed a fake condition improved the overall mean PROMIS-29+2 (version 2.1) T-scores by 1-2 points and the PROMIS preference-based score by 0.04. Although they did not endorse a fake condition at baseline, 6% (n=59) of them endorsed at least 1 of them on the 3-month survey and they had lower PROMIS-29+2 score internal consistency reliability and worse mean scores on the 3-month survey than those who did not report having a fake condition. Based on these results, we estimate that 25% (1708/6832) of the MTurk respondents provided careless or dishonest responses.

CONCLUSIONS

This study provides evidence that asking about fake health conditions can help to screen out respondents who may be dishonest or careless. We recommend this approach be used routinely in samples of members of MTurk.

Shadow Coaching Improves Patient Experience for English-Preferring Patients but not for Spanish-Preferring Patients

BACKGROUND

Shadow coaching, a type of one-on-one provider counseling by trained peers, is an effective strategy for improving provider behaviors and patient interactions, but its effects on improving patient experience for English- and Spanish-preferring patients is unknown.

OBJECTIVE

Assess effects of shadow coaching on patient experience for English- and for Spanish-preferring patients.

DESIGN

We analyzed 2012-2019 Clinician and Group Consumer Assessment of Healthcare Providers and Systems (CG-CAHPS) data (n=46,089) from an urban Federally Qualified Health Center with 44 primary care practices and 320 providers. One-third (n=14,631) were Spanish-preferring patients. We fit mixed-effects regression models with random effects for provider (the level of treatment assignment) and fixed effects for time (a linear spline for time with a knot and "jump" at coaching date), patient characteristics, and site indicators, stratified by preferred language.

PARTICIPANTS

The 74 providers who had a 6-month average top-box score on the CAHPS overall provider rating below 90 (on a 100-point scale) were shadow coached. Similar percentages of English-preferring (45%) and Spanish-preferring patients (43%) were seen by coached providers.

INTERVENTION

Trained providers observed patient care by colleagues and provided suggestions for improvement. Verbal feedback was provided immediately after the observation and the participant received a written report summarizing the comments and recommendations from the coaching session.

MAIN MEASURES

CG-CAHPS Visit Survey 2.0 provider communication composite and overall provider rating (0-100 scoring).

KEY RESULTS

We found a statistically significant 2-point (small) jump in CAHPS provider communication and overall provider rating among English-preferring patients of coached providers. There was no evidence of a coaching effect on patient experience for Spanish-preferring patients.

CONCLUSIONS

Coaching improved care experiences for English-preferring patients but may not have improved patient experience for Spanish-preferring patients. Selection and training of providers to communicate effectively with Spanish-preferring patients is needed to extend the benefits of shadow coaching to Spanish-preferring patients.

Patient Comments on the Consumer Assessment of Healthcare Providers and Systems Clinician and Group (CG-CAHPS) Survey Reflect Improvements in Provider Behaviors From Coaching

GOAL

Patient experience survey data are used to examine the patient-centeredness of care, identify areas for improvement, and monitor interventions aimed to enhance the patient experience. Most healthcare organizations measure patient experience using Consumer Assessment of Healthcare Providers and Systems (CAHPS) surveys. Studies have documented the use of CAHPS closed-ended survey responses for completing public reports, monitoring internal feedback and performance, identifying areas of improvement, and evaluating interventions to improve care. However, limited evidence exists on the utility of patients' comments on CAHPS surveys for evaluating provider-level interventions. To explore this potential, we examined comments on the CAHPS Clinician and Group (CG-CAHPS) 2.0 visit survey before and after a provider intervention. The "shadow coaching" intervention had been shown to improve provider performance and patient experience scores on the CG-CAHPS overall provider rating and provider communication composite.

METHODS

We examined how patient comments on the CG-CAHPS survey differed before and after shadow coaching of 74 providers. We described the valence (tone), content, and actionability of 1,935 comments-1,051 collected before coaching and 884 collected after coaching-to see how these aspects changed before and after providers were coached.

PRINCIPAL FINDINGS

Patient comments reflected improved CG-CAHPS scores after shadow coaching. The proportion of positive comments increased, and comments about doctors were more positive. Comments about time spent in the examination room decreased, apparently reflecting the decreased proportion of negative comments after coaching. Comments regarding three of the four aspects of provider communication asked on the CG-CAHPS survey were more positive after coaching (provider listens carefully, shows respect, spends enough time); the valence of comments about the fourth aspect (provider explains things in a way that is easy to understand) did not change. Also, comments describing an overall positive evaluation of the practice increased. Comments were generally less actionable after coaching, perhaps reflecting the increased positivity of the comments.

PRACTICAL APPLICATIONS

Patient comments collected before the provider intervention reflected overall improvements in provider behavior, as indicated by medium-to-large statistically significant improvements in CG-CAHPS composite scores. These results suggest that patient comments from the CG-CAHPS survey can be used as input for quality improvement or an evaluation of provider-level interventions. Tracking the valence and content of comments about providers before and after an intervention to improve care is a practical method to learn how provider behavior changes.

Telephone Outreach Enhances Recruitment of Underrepresented Seriously Ill Patients for an Advance Care Planning Pragmatic Trial

BACKGROUND

Patients experiencing systemic patterns of disadvantage, such as racial/ethnic minorities and those with limited English proficiency, are underrepresented in research. This is particularly true for large pragmatic trials of potentially sensitive research topics, such as advance care planning (ACP). It is unclear how phone outreach may affect research participation by underrepresented individuals.

OBJECTIVE

To assess the effect of phone outreach, in addition to standard mail survey recruitment, in a population-based ACP pragmatic trial at three academic health systems in California.

DESIGN

Retrospective cohort study PATIENTS: Primary care patients with serious illness were mailed a survey in their preferred language. Patients who did not initially respond by mail received up to three reminder phone calls with the option of survey completion by phone.

MAIN MEASURES

Effect of phone outreach on survey response rate associated with respondent demographic characteristics (e.g., Social Vulnerability Index [SVI], range 0 (low) to 1 (high)).

RESULTS

Across the health systems, 5998 seriously ill patients were mailed surveys. We obtained completed surveys from 1215 patients (20% response rate); 787 (65%) responded after mail alone and 428 (35%) participated only after phone outreach. Patients recruited after phone outreach compared to mail alone were more socially vulnerable (SVI 0.41 v 0.35, P < 0.001), were more likely to report being a racial/ethnic minority (35% v 28%, P = 0.006), and non-English speaking (16% v 10%, P = 0.005). Age and gender did not differ significantly. The inclusion of phone outreach resulted in a sample that better represented the baseline population than mail alone in racial/ethnic minority (28% mail alone, 30% including phone outreach, 36% baseline population), non-English language preference (10%, 12%, 15%, respectively), and SVI (0.35, 0.37, 0.38, respectively).

CONCLUSIONS

Phone outreach for a population-based survey in a pragmatic trial concerning a potentially sensitive topic significantly enhanced recruitment of underrepresented seriously ill patients.

Symptoms and Satisfaction Levels Associated with Intraocular Lens Implants in the Monofocal and Premium IOL Patient-Reported Outcome Measure Study

PURPOSE

To develop a questionnaire with standardized questions and images about visual symptoms and satisfaction administered before and after cataract surgery with monofocal and various (premium) intraocular lenses (IOLs).

DESIGN

A prospective, observational study of cataract surgery patients completing a self-administered questionnaire preoperatively and postoperatively at 4 to 6 months.

PARTICIPANTS

Five hundred fifty-four patients with plans to undergo implantation of the same IOL in both eyes on separate occasions in 20 ophthalmology practices.

METHODS

An 86-item questionnaire with standardized images assessed the following 14 symptoms: glare, blurry vision, starbursts, hazy vision, snowballs, halos, floaters, double images, rings and spider webs, light flashes with eyes closed, distortion, light flashes with eyes open, shimmering images, and dark crescent-shaped shadows.

MAIN OUTCOME MEASURES

Symptom severity and level of symptom bother, satisfaction with vision, quality of vision, and ability to see without corrective lenses or eyeglasses.

RESULTS

Except for dark crescent-shaped shadows, the report of visual symptoms significantly decreased postoperatively. Best uncorrected binocular visual acuity improved from 0.47 (20/59 Snellen visual acuity values) ± 0.35 logarithm of the minimum angle of resolution (logMAR) preoperatively to 0.12 (20/26 Snellen visual acuity values) ± 0.12 logMAR postoperatively. Patients' ratings of intermediate vision as good to excellent improved significantly from 12% preoperatively to 71% postoperatively, and patients' ratings of distance vision improved from 8% preoperatively to 85% postoperatively. After surgery, 84% reported that they were somewhat, very, or completely satisfied with their vision. Most patients (88%) reported that they could see pretty well, very well, or perfectly well without corrective lenses after surgery.

CONCLUSIONS

The Assessment of IntraOcular Lens Implant Symptoms questionnaire can be used across a wide variety of IOLs to evaluate visual symptoms and satisfaction with a growing segment of the market, premium IOLs, that target intermediate and near vision, in addition to distance vision. Compared to patients receiving monofocal IOLs, patients receiving premium IOLs appear to be more challenging to satisfy because of their requirements for distance, intermediate, and near vision, and their desire to be free of eyeglasses postoperatively. This instrument provides a structured, uniform tool for regulators, researchers, and ophthalmologists in everyday practice to gain insights into patients' experiences.

FINANCIAL DISCLOSURE(S)

The author(s) have no proprietary or commercial interest in any materials discussed in this article.

Development of a Patient-Reported Outcome Measure to Assess Symptoms Associated with Cataract Surgery and Intraocular Lens Implants

PURPOSE

To develop a standardized patient-reported outcome measure of visual perceptions and symptoms for implanted premium and monofocal intraocular lenses (IOLs).

DESIGN

Observational study before and after IOL implants to assess the measure and symptom experience.

PARTICIPANTS

Adults scheduled for binocular implantation of the same IOL type completed the survey at baseline prior to surgery (n = 716) and postoperatively (n = 554). Most respondents were female (64%), White (81%), 61 or older (89%), and had some college or more education (62%).

METHODS

Administration was by web survey with mail follow-up and phone reminders.

MAIN OUTCOME MEASURES

Frequency, severity, and level of symptom bother in the last 7 days for 14 symptoms: (1) glare, (2) hazy vision, (3) blurry vision, (4) starbursts, (5) halos, (6) snowballs, (7) floaters, (8) double images, (9) rings and spider webs, (10) distortion, (11) light flashes with eyes closed, (12) light flashes with eyes open, (13) shimmering images, and (14) dark shadows.

RESULTS

The median correlation among having 14 symptoms at baseline was only 0.19. Mean uncorrected binocular visual acuity improved from a preoperative value of 0.47 logarithm of the minimum angle of resolution (logMAR; Snellen 20/59) to a postoperative value of 0.12 (20/26) and best-corrected binocular visual acuity improved from 0.23 logMAR (20/34) preoperative to 0.05 logMAR (20/22) postoperative. The most bothersome symptoms were reduced after surgery: preoperative/postoperative glare (84%/36%), blurry vision (68%/22%), starbursts (66%/28%), hazy vision (63%/18%), snowballs (55%/17%), and halos (52%/22%). All symptoms decreased significantly (P < 0.0001) from before to after surgery except for dark crescent-shaped shadows (4%/4%). The percentage of symptoms rated as quite a bit or extremely bothersome declined from before to after surgery except for dark crescent-shaped shadows (29%/32%): blurry vision (54%/15%), snowballs (52%/14%), glare (49%/15%), and halos (46%/14%). Having monofocal IOL implants was associated with significantly more reduction in halos, starbursts, glare, and rings and spider webs, but less improvement in self-reported general vision.

CONCLUSIONS

This study provides support for the 37-item Assessment of IntraOcular Lens Implant Symptoms (AIOLIS) instrument for use to assess symptoms and general perceptions of vision in clinical studies and clinical care.

FINANCIAL DISCLOSURE(S)

Proprietary or commercial disclosure may be found after the references.

Vision-related quality of life compared to generic measures in retinoblastoma survivors

PURPOSE

To (1) Compare vision-related quality of life (VRQOL) in adolescent and young adult (AYA) unilateral versus bilateral retinoblastoma (RB) survivors using a vision-targeted measure and a generic health-related quality of life (HRQOL) measure and (2) Assess associations among VRQOL and generic HRQOL domains and overall QOL and estimate associations of the VRQOL and HRQOL domains with overall QOL.

METHODS

The National Institute for Health (NIH) Toolbox® VRQOL instrument, PROMIS®-29 Profile v 2.1, and a single-item QOL measure were administered in a cross-sectional study of 101 RB survivors. Reliability for multi-item scales was estimated. Product-moment and Spearman rank correlation coefficients and stepwise ordinary least squares were used to measure associations of other variables with overall QOL.

RESULTS

Significantly worse VRQOL was reported by bilateral than unilateral RB survivors. Cronbach's alpha coefficients for all VRQOL scales ranged from 0.83 to 0.95. Medium to large correlations were found between all NIH Toolbox® VRQOL scales and the PROMIS®-29 measures. Depression and ability to participate in social roles and activities from the PROMIS®-29 Profile accounted for 38% of the variance in overall QOL with the psychosocial domain of the NIH Toolbox® VRQOL explaining 16% of the variance.

CONCLUSION

VRQOL is impaired in bilateral RB survivors. VRQOL is associated substantially with the PROMIS-29 generic HRQOL measure but has significant unique associations with overall QOL. The NIH Toolbox® VRQOL measure provides important information about the vision-related effects on daily life of AYA RB survivors.

Longitudinal Associations of PROMIS-29 Anxiety and Depression Symptoms With Low Back Pain Impact in a Sample of U.S. Military Service Members

INTRODUCTION

The Impact Stratification Score (ISS) is a measure of the impact of chronic low back pain (LBP) consisting of nine Patient-Reported Outcomes Measurement Information System (PROMIS-29) items, but no studies have examined the ISS or its association with psychological symptoms in military samples. This study examines longitudinal associations between psychological symptoms and the ISS among military service members.

MATERIAL AND METHODS

The study involved secondary data analysis of a sample of active duty U.S. military service members aged 18-50 years with LBP (n = 733). Participants completed the PROMIS-29 at three time points during treatment: baseline (time 1, T1), week 6 of treatment (time 2, T2), and week 12 of treatment (time 3, T3). The impact of LBP was quantified using the ISS (ranging from 8 = least impact to 50 = greatest impact). Psychological symptoms were assessed as PROMIS-29 anxiety and depression scores. Separate autoregressive cross-lagged models examined reciprocal associations of ISSs with anxiety, depression, and emotional distress scores from T1 to T3.

RESULTS

Within each time point, the ISS was significantly and positively correlated with anxiety and depression. In autoregressive cross-lagged models, anxiety and depression predicted the ISS at the next time point and associations were similar in magnitude (e.g., anxiety T2 to ISS T3: β = 0.12, P < .001; depression T2 to ISS T3: β = 0.12, P <.001). The ISS did not predict future depression or emotional distress scores at any time point, but the ISS at T2 was significantly, positively associated with anxiety scores at T3 (β = 0.07, P = .04).

CONCLUSION

Psychological symptoms consistently and prospectively predict the impact of LBP as measured by the ISS among service members undergoing pain treatment. The ISS may also be associated with future anxiety but not depression. PROMIS-29 anxiety and depression items may be useful adjunctive measures to consider when using the ISS to support LBP treatment planning and monitoring with service members.

Simulation study comparing analytical methods for single-item longitudinal patient-reported outcomes data

PURPOSE

Efficient analytical methods are necessary to make reproducible inferences on single-item longitudinal ordinal patient-reported outcome (PRO) data. A thorough simulation study was performed to compare the performance of the semiparametric probabilistic index models (PIM) with a longitudinal analysis using parametric cumulative logit mixed models (CLMM).

METHODS

In the setting of a control and intervention arm, we compared the power of the PIM and CLMM to detect differences in PRO adverse event (AE) between these groups using several existing and novel summary scores of PROs. For each scenario, PRO data were simulated using copula multinomial models. Comparisons were also exemplified using clinical trial data.

RESULTS

On average, CLMM provided substantially greater power than the PIM to detect differences in PRO-AEs between the groups when the baseline-adjusted method was used, and a small advantage in power when using the baseline symptom as a covariate.

CONCLUSION

Although the CLMM showed the best performance among analytical methods, it relies on assumptions difficult to verify and that might not be fulfilled in the real world, therefore our recommendation is the use of PIM models with baseline symptom as a covariate.

Definitions of Chronic Low Back Pain From a Scoping Review, and Analyses of Narratives and Self-Reported Health of Adults With Low Back Pain

Among those with low back pain (LBP), individuals with chronic LBP (CLBP) face different treatment recommendations and incur the majority of suffering and costs. However, the way CLBP has been defined varies greatly. This study used a scoping review and qualitative and quantitative analyses of data from LBP patients to explore this variation. CLBP in most recent randomized controlled trials (RCTs) was defined by duration of pain, most commonly ≥3 months. However, individuals with LBP most often define CLBP by frequency. CLBP has also been defined using a combination of duration and frequency (16% of RCTs and 20% of individuals), including 6% of recent RCTs that followed the NIH Pain Consortium research task force (RTF) definition. Although not a defining characteristic of CLBP for individuals, almost 15% of recent RCTs required CLBP to have a healthcare provider diagnosis. In our LBP sample moving from ≥3 months to the RTF definition reduced the CLBP group size by 25% and resulted in a group that used more pain management options and reported worse health across all outcome measures. A pain duration definition offers ease of application. However, refinements to this definition (eg, RTF) can identify those who may be better intervention targets. PERSPECTIVE: This article presents the definitions used for CLBP by researchers and individuals, and the impact of these definitions on pain management and health outcomes. This information may help researchers choose better study inclusion criteria and clinicians to better understand their patients' beliefs about CLBP.

Crosswalking the National Institutes of Health Impact Stratification Score to the PEG

OBJECTIVE

To crosswalk the National Institutes of Health (NIH) Pain Consortium's Research Task Force proposed Impact Stratification Score (ISS) to the PEG (Pain Intensity, Interference With Enjoyment of Life, Interference With General Activity) Scale.

DESIGN

Cross-sectional data collected in 2021. Ordinary least squares regression analyses of ISS and PEG.

SETTING

Amazon Mechanical Turk workers.

PARTICIPANTS

1931 adults with back pain with an average age of 41 (range, 19-77); 48% were female, 16% Hispanic, 7% non-Hispanic Black, 5% non-Hispanic Asian, and 71% non-Hispanic White (N=1931).

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

The Patient-Reported Outcomes Measurement Information System (PROMIS)-29+2 v2.1 survey that includes the ISS, and the 3-item PEG.

RESULTS

The ISS and PEG had a correlation coefficient of 0.74. The ISS accounted for 55% of the adjusted variance in the PEG and the standardized average deviation between observed and predicted scores (normalized mean absolute error) was 0.53. Likewise, the PEG explained 55% of the variance in the ISS with a normalized mean absolute error of 0.52.

CONCLUSIONS

This study provides a crosswalk between the ISS and PEG that can be used to predict one from the other. The regression equations can facilitate comparisons in studies that use different measures.

Follow-Up Shadow Coaching Improves Primary Care Provider-Patient Interactions and Maintains Improvements When Conducted Regularly: A Spline Model Analysis

INTRODUCTION

Shadow coaching improves provider-patient interactions, as measured by CG-CAHPS® overall provider rating (OPR) and provider communication (PC). However, these improvements erode over time.

AIM

Examine whether a second coaching session (re-coaching) improves and sustains patient experience.

SETTING

Large, urban Federally Qualified Health Center PROGRAM: Trained providers observed patient care by colleagues and provided suggestions for improvement. Providers with OPRs<90 (0-100-point scale) were eligible.

EVALUATION

We used stratified randomization based on provider type and OPR to assign half of the 40 eligible providers to re-coaching. For OPR and PC, we fit mixed-effects regression models with random-effects for provider (level of treatment assignment) and fixed-effects for time (linear spline with knots and possible "jump" at initial coaching and re-coaching), previous OPR, patient characteristics, and sites. We observed a statistically significant medium jump among re-coached providers after re-coaching on OPR (3.7 points) and PC (3.5 points); differences of 1, 3, and ≥5-points for CAHPS measures are considered small, medium, and large. Improvements from re-coaching persisted for 12 months for OPR and 8 months for PC.

DISCUSSION

Re-coaching improved patient experience more than initial coaching, suggesting the reactivation of knowledge from initial coaching. However, re-coaching gains also eroded. Coaching should occur every 6 to 12 months to maintain behaviors and scores.

Reasons Primary Care Practices Chose Patient Experience Surveys During Patient-Centered Medical Home Transformation

Patient-centered medical home takes years to attain. Fifteen-to-eighteen percent of US primary care practices in 2008-2017 sought or maintained patient-centered medical home recognition. We conducted interviews with a stratified-random sample of 105 of these practices to determine why patient experience surveys were chosen. Fifty-one were using a Consumer Assessment of Healthcare Providers and Systems survey and 53 administering another patient survey. The 3 most common reasons were (1) to compare performance against other practices, which requires systematically collected data across large numbers of practices (ie, the Consumer Assessment of Healthcare Providers and Systems survey), (2) participation in an external patient-centered medical home program, and (3) survey administration cost. Leaders invested in a second patient survey for quality improvement needs.

Current Postlaunch Implementation of State Mandates of Newborn Screening for Critical Congenital Heart Disease by Pulse Oximetry in U.S. States and Hospitals

OBJECTIVE

 Our objective was to gauge adherence to nationally endorsed protocols in implementation of pulse oximetry (POx) screening for critical congenital heart disease (CCHD) in infants after mandate by all states and to assess associated characteristics.

STUDY DESIGN

 Between March and October 2019, an online questionnaire was administered to nurse supervisors who oversee personnel conducting POx screening. The questionnaire used eight questions regarding performance and interpretation of screening protocols to measure policy consistency, which is adherence to nationally endorsed protocols for POx screening developed by professional medical societies. Multilevel linear regression models evaluated associations between policy consistency and characteristics of hospitals and individuals, state of hospital location, early versus late mandate adopters, and state reporting requirements.

RESULTS

 Responses from 189 nurse supervisors spanning 38 states were analyzed. Only 17% received maximum points indicating full policy consistency, and 24% selected all four options for potential hypoxia that require a repeat screen. Notably, 33% did not recognize ≤90% SpO2 as an immediate failed screen and 31% responded that an infant with SpO2 of 89% in one extremity will be rescreened by nurses in an hour rather than receiving an immediate physician referral. Lower policy consistency was associated with lack of state reporting mandates (beta = -1.23 p = 0.01) and early adoption by states (beta = -1.01, p < 0.01).

CONCLUSION

 When presented with SpO2 screening values on a questionnaire, a low percentage of nurse supervisors selected responses that demonstrated adherence to nationally endorsed protocols for CCHD screening. Most notably, almost one-third of respondents did not recognize ≤90% SpO2 as a failed screen that requires immediate physician follow-up. In addition, states without reporting mandates and early adopter states were associated with low policy consistency. Implementing state reporting requirements might increase policy consistency, but some inconsistency may be the result of unique protocols in early adopter states that differ from nationally endorsed protocols.

KEY POINTS

· Low adherence to nationally endorsed protocols.. · Inconsistent physician follow-up to hypoxia.. · Reporting improved consistency with national policy..

Veteran knowledge, perceptions, and receipt of care following visits to VA emergency departments for ambulatory care sensitive conditions

OBJECTIVE

Receipt of follow-up care after emergency department (ED) visits for chronic ambulatory care sensitive conditions (ACSCs)-asthma, chronic obstructive pulmonary disease, heart failure, diabetes, and/or hypertension-is crucial. We assessed Veterans' follow-up care knowledge, perceptions, and receipt of care after visits to Veterans Health Administration (VA) EDs for chronic ACSCs.

METHODS

Using explanatory sequential mixed methods, we interviewed Veterans with follow-up care needs after ACSC-related ED visits, and manually reviewed ED notes, abstracting interviewees' documented follow-up needs and care received.

RESULTS

We interviewed and reviewed ED notes of 35 Veterans, 12-27 (mean 19) days after ED visits. Follow-up care was completely received/scheduled in 20, partially received/scheduled in eight, and not received in seven Veterans. Among those who received care, it was received within specified time frames half the time. However, interviewees often did not recall these time frames or reported them to be longer than specified in the ED notes. Veterans who had not yet received or scheduled follow-up care commonly did not recall follow-up care instructions, believed that they did not need this care since they were not currently having symptoms, or thought that such care would be difficult to obtain due to appointment unavailability and/or difficulties communicating with follow-up care providers. Among the 28 Veterans in whom all or some follow-up care had been received/scheduled, for 25 cases VA staff reached out to the Veteran or the appointment was scheduled prior to or during the ED visit.

CONCLUSIONS

VA should prioritize implementing processes for EDs to efficiently communicate Veterans' needs to follow-up care providers and systems for reaching out to Veterans and/or arranging for care prior to Veterans leaving the ED. VA should also enhance practices using multimodal approaches for educating Veterans about recommended ED follow-up care and improve mechanisms for Veterans to communicate with follow-up care providers.

A Systematic Review of Strategies to Enhance Response Rates and Representativeness of Patient Experience Surveys

BACKGROUND

Data from surveys of patient care experiences are a cornerstone of public reporting and pay-for-performance initiatives. Recently, increasing concerns have been raised about survey response rates and how to promote equity by ensuring that responses represent the perspectives of all patients.

OBJECTIVE

Review evidence on survey administration strategies to improve response rates and representativeness of patient surveys.

RESEARCH DESIGN

Systematic review adhering to the Preferred Reporting Items for Systematic reviews and Meta-Analyses guidelines.

STUDY SELECTION

Forty peer-reviewed randomized experiments of administration protocols for patient experience surveys.

RESULTS

Mail administration with telephone follow-up provides a median response rate benefit of 13% compared with mail-only or telephone-only. While surveys administered only by web typically result in lower response rates than those administered by mail or telephone (median difference in response rate: -21%, range: -44%, 0%), the limited evidence for a sequential web-mail-telephone mode suggests a potential response rate benefit over sequential mail-telephone (median: 4%, range: 2%, 5%). Telephone-only and sequential mixed modes including telephone may yield better representation across patient subgroups by age, insurance type, and race/ethnicity. Monetary incentives are associated with large increases in response rates (median increase: 12%, range: 7%, 20%).

CONCLUSIONS

Sequential mixed-mode administration yields higher patient survey response rates than a single mode. Including telephone in sequential mixed-mode administration improves response among those with historically lower response rates; including web in mixed-mode administration may increase response at lower cost. Other promising strategies to improve response rates include in-person survey administration during hospital discharge, incentives, minimizing survey language complexity, and prenotification before survey administration.

Toxicity Index, patient-reported outcomes, and persistence of breast cancer chemotherapy-associated side effects in NRG Oncology/NSABP B-30

Adjuvant chemotherapy improves breast cancer survival but is associated with bothersome short- and long-term toxicity. Factors associated with toxicity, especially subacute toxicity up to 2 years following chemotherapy, have not been fully elucidated. The NRG Oncology/NSABP B-30 clinical trial compared 3 different doxorubicin-, cyclophosphamide-, and docetaxel-based chemotherapy regimens given over 3–6 months. Patients with hormone receptor-positive breast cancer received subsequent adjuvant endocrine therapy. From baseline through 24 months, 2156 patients completed questionnaires serially. We used multivariable probabilistic index models to identify factors associated with acute (>0–12 months) and subacute (>12–24 months) difficulties with pain, cognition, vasomotor symptoms, and vaginal symptoms. For all symptom domains, presence of symptoms prior to chemotherapy initiation were associated with symptoms in the subacute period (all p < 0.001). In addition, different combinations of patient factors and breast cancer treatments were associated with increased likelihood of pain, vasomotor, and vaginal symptoms in the subacute period. Consideration of pre-treatment symptoms and patient factors, as well as treatments for breast cancer, can facilitate identification of groups of patients that may experience symptoms following completion of chemotherapy. This information may be important for treatment-decision-making when alternative regimens are equivalent in benefit.

Associations of pediatric nurse burnout with involvement in quality improvement

PURPOSE

Burnout among nurses negatively impacts patient care experiences and safety. Inpatient pediatric nurses are high-risk for burnout due to high patient volumes, inadequate staffing, and needing to balance the demands of patients, families and team members. We examined the associations of inpatient pediatric nurse burnout with their perspectives on the importance of quality at the hospital, patient experience measurement, quality improvement (QI), unit culture, and staffing.

METHODS

We conducted a cross-sectional study at an urban children's hospital. We surveyed pediatric nurses about their perspectives including the single-item Maslach Burnout Inventory. We fit separate regression models, controlling for role, location and unit, predicting outcome measures from the dichotomized burnout scale.

RESULTS

Twenty-seven percent of pediatric nurses reported burnout. Nurses who had more confidence in patient experience measurement, received frequent patient experience performance reports, felt included in QI, and experienced QI efforts as integrated into patient care reported not being burned out (compared to those reporting burnout; all p-values<0.05). More open communication among nurses (e.g., about possible problems with care) and unit-level teamwork were also associated with not being burned out, whereas a larger QI workload was associated with burnout (p-values<0.05).

CONCLUSIONS

Open communication among nurses and nurses being more involved and valued in QI efforts were related to not being burned out. Research is needed to further examine aspects of QI involvement that reduce burnout.

PRACTICE IMPLICATIONS

Supporting open communication among pediatric nurses, engaging them in QI and integrating QI into patient care while minimizing QI workload may decrease burnout.

Poor self-rated mental health and Medicare beneficiaries' routine care-seeking

OBJECTIVES

To assess the relationship between self-rated mental health (SRMH) and infrequent routine care among Medicare beneficiaries and to investigate the roles of managed care and having a personal doctor.

STUDY DESIGN

Cross-sectional analysis of data from the 2018 Medicare Consumer Assessment of Healthcare Providers and Systems survey.

METHODS

Logistic regression was used to predict infrequent routine care (having not made an appointment for routine care in the last 6 months) from SRMH, Medicare coverage type (fee-for-service [FFS] vs Medicare Advantage [MA], the managed care version of Medicare), and the interaction of these variables. Models that did and did not include having a personal doctor were compared. All models controlled for demographics and physical health.

RESULTS

Overall, 14.9% of beneficiaries did not make a routine care appointment in the last 6 months, with rates adjusted for demographics and physical health ranging from 14.5% for those with "excellent" SRMH to 19.2% for those with "poor" SRMH. Beneficiaries with poor SRMH were less likely to make a routine care appointment in FFS than in MA (20.1% vs 16.4%, respectively, had not done so in the last 6 months; P < .05). Accounting for having a personal doctor reduced the association between SRMH and infrequent routine care by about a third.

CONCLUSIONS

Extra efforts are needed to ensure receipt of routine care by beneficiaries with poor mental health-particularly in FFS, where more should be done to ensure that beneficiaries have a personal doctor.

Health-Related Quality of Life in Adolescent and Young Adult Retinoblastoma Survivors

Background: Retinoblastoma (RB) is a malignant intraocular tumor diagnosed in early childhood that requires extensive medical and surgical treatment at a young age. Health-related quality of life (HRQOL) is thought to be diminished due to visual impairment, facial deformities, and fear of recurrence or secondary cancer. However, few studies have identified variables associated with HRQOL among those with RB. Purpose: To compare HRQOL of adolescents and young adults (AYAs) with RB to matched controls and to identify predictors of HRQOL in RB survivors. Methods: Using a cross-sectional design, 198 AYAs (101 RBs and 97 controls) completed HRQOL (PROMIS®-29 profile) and psychosocial questionnaires (Rosenberg self-esteem scale, multidimensional scale of perceived social support, and Hollingshead index for socioeconomic status). Clinical variables (age at diagnosis, visual acuity, laterality, heredity, treatment regime, and anesthesia exposure) were extracted from the medical record. Correlates of HRQOL were estimated using linear regression models. Results: RB survivors reported similar HRQOL compared to controls. Physical function (p < .001), social support (p = .013), and self-esteem (p = .028) were lower in the RB group compared to controls. Visual acuity and self-esteem accounted for 52% of the variance in PROMIS physical health summary scores and self-esteem accounted for 38% of the variance in mental health summary scores. Conclusion: Despite deficits in physical function and self-esteem HRQOL in RB survivors was comparable to healthy counterparts. However, the majority of RB survivors in this study had normal visual acuity. Clinicians should explore ways to enhance self-esteem in RB survivors.

Analyses of Cross-Sectional Data to Link the PEG With the Patient Reported Outcomes Measurement and Information System (PROMIS) Global Physical Health Scale

It is challenging to synthesize findings across studies of pain impact. This study develops a link to estimate the Patient-Reported Outcomes Measurement Information System (PROMIS) global health measure from the 3-item Pain intensity, interference with Enjoyment of life, interference with General activity (PEG) scale. The PROMIS and PEG items were administered to 795 adults (average age = 51; 54% female, 79% White). We estimated correlations among the PEG and PROMIS items and conducted factor analysis to identify the best subset of PROMIS items for linking to the PEG. An item response theory graded response model was estimated to link the PEG with the 4-item PROMIS global physical health scale. A categorical single-factor model and a bifactor model provided support for a single dimension for the PEG and PROMIS global physical health items. The product-moment correlation between estimated PROMIS global physical health scale from the PEG and the actual global physical health score was .74. The mean difference between estimated PROMIS global physical health scale score from the PEG and the observed global physical health score was less than a T-score point. This study makes it possible to estimate the average global physical health for group-level comparisons in research that includes the PEG. PERSPECTIVE: This article describes an empirical link of the PEG to the PROMIS global physical health scale that makes it possible to estimate the average global physical health in studies that include the PEG. This link can facilitate comparisons among studies that have not administered the PEG or the PROMIS global health scale.

Comparing Data Collected on Amazon's Mechanical Turk to National Surveys

OBJECTIVE

In this study, we examined the impact of a range of methods to improve data quality on the demographic and health status representativeness of Amazon Mechanical Turk (MTurk) samples.

METHODS

We developed and field-tested a general survey of health on MTurk in 2017 among 5755 participants and 2021 among 6752 participants. We collected information on participant demographic characteristics and health status and implemented different quality checks in 2017 and 2021.

RESULTS

Adding data quality checks generally improves the representativeness of the final MTurk sample, but there are persistent differences in mental health and pain conditions, age, education, and income between the MTurk population and the broader US population.

CONCLUSION

We conclude that data quality checks improve the data quality and representativeness.

Unpacking the impact of chronic pain as measured by the impact stratification score

Background

In 2014, the National Institute of Health Pain Consortium’s research task force on research standards for chronic low back pain (CLBP) proposed a measure that could be used to stratify patients by the impact CLBP has on their lives, namely the Impact Stratification Score (ISS). This study examines the dimensionality of the ISS and support for its single total score, and evaluates its overall psychometric properties.

Methods

The sample included 1677 chiropractic patients being treated for CLBP and chronic neck pain, had an average age of 49, 71% female, and 90% White. Study participants completed the PROMIS-29 v2.1 profile survey that contains the 9 ISS items. The ISS was evaluated using item-total correlations, Cronbach’s alpha, factor analysis (i.e., correlated factors and bifactor models), and item response theory (IRT). Reliability indices and item properties were evaluated from bifactor and IRT models, respectively.

Results

Item-total correlations were high (0.64–0.84) with a Cronbach’s alpha of 0.93. Eigenvalues suggested the possibility of two factors corresponding to physical function and pain interference/intensity. Bifactor model results indicated that data were essentially unidimensional, primarily reflecting one general construct (i.e., impact) and that after accounting for ‘impact’ very little reliable variance remained in the two group factors. General impact scores were reliable (omegaH = .73). IRT models showed that items were strong indicators of impact and provided information across a wide range of the impact continuum and offer the possibility of a shorter 8-item ISS. Finally, it appears that different aspects of pain interference occur prior to losses in physical function.

Conclusions

This study presents evidence that the ISS is sufficiently unidimensional, covers a range of chronic pain impact and is a reliable measure. Insights are obtained into the sequence of chronic pain impacts on patients’ lives.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12891-022-05834-4.

A Scoping Review of Chronic Low Back Pain Classification Schemes Based on Patient-Reported Outcomes

BACKGROUND

In 2014, the National Institutes of Health Pain Consortium Research Task Force recommended that patients with chronic low back pain (CLBP) be stratified by its impact on their lives. They proposed the Impact Stratification Score (ISS) to help guide therapy and facilitate study comparability. The ISS has been evaluated as a continuous measure, but not for use as a stratification or classification scheme.

OBJECTIVES

Identify the characteristics of successful schemes to inform the use of the ISS for stratification or classification.

STUDY DESIGN

Scoping review of the peer-reviewed literature.

METHODS

Search of PubMed, CINAHL, and APA PsycInfo to identify patient self-report-based classification schemes applicable to CLBP. Data were captured on the methods used for each scheme's development, the domains covered, their scoring criteria and what the classification has successfully measured. The study was reviewed and approved by the RAND Human Subjects Protection Committee (2019-0651-AM02).

RESULTS

The search identified 87 published articles about the development and testing of 5 classification schemes: 1) The Subgroups for Targeted Treatment (STarT) Back Screening Tool, 2) Multiaxial Assessment of Pain, 3) Graded Chronic Pain Scale, 4) Back Pain Classification Scale, and 5) Chronic Pain Risk Score. All have been shown to be predictive of future outcomes and the STarT Back has been found useful in identifying effective classification-specific treatment. Each scheme had a different classification scoring structure, was developed using different methods, and 3 included domains not found in the ISS.

LIMITATIONS

Expanding the search to other databases may have identified more classification schemes. Our minimum number of publications inclusion criterion eliminated dozens of cluster analyses, some of which may have eventually been replicated.

CONCLUSIONS

The methods used to develop these successful classification schemes, especially those that use straightforward scoring schemes, should be considered for use in the development of a scheme based on the ISS.

Race and Ethnicity Differences in Walking and Associations with Neighborhood Perceptions among Older Adults in California

This paper estimates differences in walking and associations of walking with neighborhood perceptions among older adults in California. We analyzed the restricted-use California Health Interview Survey data merged with the American Community Survey data. Walking at least 10 minutes for leisure in the last 7 days and number of minutes walked were regressed on perceived neighborhood social cohesion scale (PNSCS) and neighborhood socioeconomic characteristics. We estimated ordinary least squares regression models. We found that positive neighborhood perceptions were significantly (p< 0.05) associated with walking among older Hispanic and Asian adults. Older Hispanic adults with above median PNSCS report that they walk 6.3 percentage points more than Non-Hispanic White adults. Older adults' perceptions of their neighbors and neighborhoods are positively correlated with walking. Policymakers can consider ways to improve neighborhood perceptions and relationships to help increase walking among minority older adults especially in low SES neighborhoods.

Likely change indexes improve estimates of individual change on patient-reported outcomes

PURPOSE

Individual change on a patient-reported outcome (PRO) measure can be assessed by statistical significance and meaningfulness to patients. We explored the relationship between these two criteria by varying the confidence levels of the coefficient of repeatability (CR) on the Patient-Reported Outcomes Measurement Information System (R) Physical Function (PF) 10a (PF10a) measure.

METHODS

In a sample of 1129 adult cancer patients, we estimated individual-change thresholds on the PF10a from baseline to 6 weeks later with the CR at 50%, 68%, and 95% confidence. We also assessed agreement with group- and individual-level thresholds from anchor-based methods [mean change and receiver operating characteristic (ROC) curve] using a PF-specific patient global impression of change (PGIC).

RESULTS

CRs at 50%, 68%, and 95% confidence were 3, 4, and 7 raw score points, respectively. The ROC- and mean-change-based thresholds for deterioration were -4 and -6; for improvement they were both 2. Kappas for agreement between anchor-based thresholds and CRs for deterioration ranged between κ = 0.65 and 1.00, while for improvement, they ranged between 0.35 and 0.83. Agreement between the PGIC and all CRs always fell below "good" (κ < 0.40) for deterioration (0.30-0.33) and were lower for improvement (0.16-0.28).

CONCLUSIONS

In comparison to the CR at 95% confidence, CRs at 50% and 68% confidence (considered likely change indexes) have the advantage of maximizing the proportion of patients appropriately classified as changed according to statistical significance and meaningfulness.

A Patient Reported Outcome Ontology: Conceptual Issues and Challenges Addressed by the Patient-Reported Outcomes Measurement Information System® (PROMIS®)

We briefly review the history of measuring perceptions of health and quality of life, followed by an examination of conceptual issues related to terminology that have led to potentially conflicting ontologies. Then, we discuss challenges posed by the lack of consensus on common meaning and the proliferation of measures. Next, we suggest a solution grounded in an ontology adopted by the National Institutes of Health (NIH) funded Patient-Reported Outcomes Measurement Information System (PROMIS) project. We conclude by discussing issues associated with mapping the PROMIS domain framework onto other familiar ontologies and recommend a way forward for PROMIS to provide a sustainable ontological structure to enable coherent common measurement.

Health-related quality of life outcomes after neoadjuvant chemoradiotherapy for rectal cancer in NRG Oncology/NSABP R-04

Background

There has been limited evaluation of health‐related quality of life (HRQOL) in rectal cancer patients receiving neoadjuvant chemoradiotherapy. HRQOL outcomes in the National Surgical Adjuvant Breast and Bowel Project R‐04 trial are examined in this article.

Methods

Between 2004 and 2010, R‐04 patients were invited to enroll in the HRQOL substudy, with questionnaires administered before randomization, after completion of chemoradiotherapy, and 1‐year after surgery. HRQOL measures included: Functional Assessment of Cancer Therapy for colorectal cancer (FACT‐C); Short Form‐36v.2 Vitality scale; a treatment‐specific symptom scale; and the FACT neurotoxicity scale. A 5‐year postsurgery assessment was added to the protocol in 2012. Mixed‐effects models examined neoadjuvant therapy treatment effects in the 1‐year sample and models that explored associations of host factors and treatment impact on 5‐year HRQOL.

Results

A total of 1373 patients completed baseline HRQOL and at least one additional assessment. The average age was 58 years (range, 23–85 years), male (68%), and 59% Stage II. There were no statistically significant differences in HRQOL outcomes by treatment arm, but HRQOL worsened from baseline to postneoadjuvant chemoradiotherapy, with statistically significant effect sizes changes ranging from 0.6 (Vitality) to 0.9 (FACT‐C Trial Outcome Index). Neurotoxicity was greater in the oxaliplatin‐treated groups. Obese/overweight patients had statistically significantly worse FACT‐C Trial Outcome Index scores than did underweight/normal weight groups. At 5 years, younger patients and those with normal baseline weight had statistically significantly better physical function scores and older patients had better mental health outcomes.

Conclusions

HRQOL did not differ across the four R‐04 treatment arms; however, host factors explained significant variation in posttreatment HRQOL. ClinicalTrials.gov: NCT00058474 (https://ClinicalTrials.gov/ct2/show/NCT00058474).

Lay summary

This article reports on the health‐related quality of life (HRQOL) outcomes of patients treated with four different chemotherapy regimens combined with radiation in rectal cancer patients before definitive surgical treatment.

There were no significant differences in HRQOL by treatment regimen, but all patients experienced decreased vitality (energy) and physical functioning. By 1 year after treatment, most patients had returned to pretreatment vitality and physical functioning, with the exception of increased neurotoxicity.

In a subsample of patients assessed at 5 years after surgery, physical function was better in those who at pretreatment were younger, normal weight, and had better performance status. Mental function was better in those who at pretreatment were older and had better performance status.

.

Assessing the Significance of Individual Change in 2 Samples of Patients in Treatment for Low Back Pain Using 5 Different Statistical Indicators

OBJECTIVE

The purpose of this study was to estimate the significance of individual change using 5 statistical indicators in 2 samples of patients treated for low back pain.

METHODS

This secondary analysis used observational and clinical trial data from 2 samples of patients with low back pain to compare 5 ways of estimating significant individual change on the Impact Stratification Score (ISS) administered at the following 2 time points: 3 months apart in an observational study of 1680 patients undergoing chiropractic care, and 6 weeks apart in a randomized trial of 750 active-duty military personnel with low back pain. The following 5 methods were compared: (1) standard deviation index; (2) standard error of measurement (SEM); (3) standard error of estimate (SEE); (4) standard error of prediction (SEP); and (5) the reliable change index (RCI). The ISS is the sum of the Patient-Reported Outcomes Measurement Information System (PROMIS)-29 v2.1 physical function, pain interference, and pain intensity scores and is scored to have a possible range of 8 (least impact) to 50 (greatest impact).

RESULTS

The amount of change on the ISS needed for significant individual change in both samples was 5 for the SEM and for the SEE and 7 for the SEP and RCI.

CONCLUSIONS

The results of the current study provide some preliminary support for use of the SEP or the RCI to identify significant individual change and provide estimated thresholds of individual change that can be used for the ISS. The SEP and RCI estimates of significant change were consistent with retrospective ratings of change of at least moderately better in prior research. These 2 were less likely than other methods to classify people with low back pain as responders who have not actually gotten better (false positive). In contrast, the SEM and SEE were less likely to miss real change (false negative).