Key concepts in clinical epidemiology: Responsiveness, the longitudinal aspect of validity

Reliability and responsiveness of the Swedish short Hip-RSI

Purpose

The aim of this study was to examine test-retest reliability and responsiveness of the short version (6-item) Hip Return to Sport after Injury (Hip-RSI) scale in patients following hip arthroscopy.

Methods

The study included 100 hip arthroscopy patients responding to a digital survey including the short version (6-item) Hip-RSI, International Hip Outcome Tool (short version) (iHOT-12) and RTS status 3, 6 and 9 months following surgery. The Hip-RSI was administered twice at 3-month follow-up. Test-retest reliability was evaluated using intraclass correlation coefficients. Responsiveness was tested by correlations between changes in Hip-RSI and iHOT-12 scores and by comparing change in Hip-RSI scores of patients who progressed on the return to sport (RTS) continuum (from return to any sport to return to performance) to patients who did not, using independent samples t-tests.

Results

Hip-RSI was found to have excellent test-retest reliability on the individual (intraclass correlation coefficient, ICC [95% confidence interval, CI]: 0.90 [0.83-0.94]) and group level (ICC [95% CI]: 0.95 [0.91-0.97]) with a standard error of measurement of 5.53 and smallest detectable change of 15.3 on the individual and 2.2 on the group level. Hip-RSI was found responsive to change through positive correlations of changes in scores with changes in iHOT-12 scores from 3 to 6 months (r [95% CI]: 0.51 [0.35-0.65]; p < 0.001) and from 3 to 9 months following arthroscopy (r [95% CI]: 0.61 [0.57-0.79); p < 0.001). Further responsiveness was shown by significant mean changes in scores among patients that progressed on the RTS-continuum (3-6 months: 8.6 [95% CI: 3.8- 13.5); 3-9 months: 12.6 [5.6-19.7]).

Conclusion

The short version (6-item) Hip-RSI demonstrated excellent test-retest reliability and responsiveness to change in the evaluation of psychological readiness to RTS following hip arthroscopy.

Level of Evidence

Level II.

The psychometric properties of the Six-Spot Step Test - a systematic review using the COSMIN guidelines

OBJECTIVE

Accurate and reliable balance measures are important for prescribing fall prevention treatments and monitoring their effectiveness. Thus, we aimed to systematically review the psychometric properties of the Six-Spot Step Test, an increasingly used measure of dynamic balance.

DATA SOURCES

A literature search using the free-text term "Six-Spot Step Test" was performed on 12 February 2024, in Medline, Embase, Rehabilitation & Sports Medicine and SPORTDiscus. Eligibility criteria were adults aged 18 or more, trials evaluating the psychometric properties of the Six-Spot Step Test, and English-language articles. Conference abstracts were excluded.

REVIEW METHODS

Two investigators screened and selected data independently and assessed the methodological quality and evidence using the COSMIN Risk of Bias checklist and modified GRADE approach. One investigator extracted study characteristics such as design, population and psychometric properties.

RESULTS

Of the 159 articles identified, 16, evaluating multiple measurement properties, were included in the final analysis. A total of 1319 people participated, including people affected by Stroke, multiple sclerosis, Parkison's disease, chronic inflammatory polyneuropathy and older adults with balance problems. Eight articles assessing reliability (n = 618, intraclass correlations coefficient ≥0.7, minimal detectable change = 22%) and 12 construct validity (n = 1082, 83% true hypothesis, area under the curve >0.7) exhibited sufficient methodological quality with high-level evidence, while two studies (n = 167) examining responsiveness showed very low evidence.

CONCLUSION

Apart from responsiveness, robust evidence supports the reliability and validity of the Six-Spot Step Test for assessing dynamic balance in a specific group of individuals with neurological diseases and older adults. Further, it is considered feasible for clinical use.

Physician and informal care use explained by the Pediatric Quality of Life Inventory (PedsQL) in children with suspected genetic disorders

PURPOSE

To examine associations between Pediatric Quality of Life Inventory (PedsQL) 4.0 Generic Core Scales and PedsQL Infant Scales with formal health care resource utilization (HCRU) and informal caregiver burden.

METHODS

We studied a pediatric cohort of 837 patients (median age: 8.4 years) with suspected genetic disorders enrolled January 2019 through July 2021 in the NYCKidSeq program for diagnostic sequencing. Using linked ~ nine-month longitudinal survey and physician claims data collected through May 2022, we modeled the association between baseline PedsQL scores and post-baseline HCRU (median follow-up: 21.1 months) and informal care. We also assessed the longitudinal change in PedsQL scores with physician services using linear mixed-effects models.

RESULTS

Lower PedsQL total and physical health scores were independently associated with increases in 18-month physician services, encounters, and weekly informal care. Comparing low vs. median total scores, increases were 10.6 services (95% CI: 1.0-24.6), 3.3 encounters (95% CI: 0.5-6.8), and $668 (95% CI: $350-965), respectively. For the psychosocial domain, higher scores were associated with decreased informal care. Based on adjusted linear mixed-effects modeling, every additional ten physician services was associated with diminished improvement in longitudinal PedsQL total score trajectories by 1.1 point (95% confidence interval: 0.6-1.6) on average. Similar trends were observed in the physical and psychosocial domains.

CONCLUSION

PedsQL scores were independently associated with higher utilization of physician services and informal care. Moreover, longitudinal trajectories of PedsQL scores became less favorable with increased physician services. Adding PedsQL survey instruments to conventional measures for improved risk stratification should be evaluated in further research.

Contributions for the Validation of the European Portuguese Version of the Vascular Quality of Life-6 Questionnaire for Peripheral Artery Disease

INTRODUCTION

Peripheral arterial disease (PAD) is an occlusive atherosclerotic disease of the arteries of the extremities of the body that affects more than 230 million people worldwide. The most common symptom is intermittent claudication, described as leg pain which occurs mainly while walking. The symptoms impair the ambulation and functional capacity of patients, leading to loss of mobility, disease deterioration, increased risk of other cardiovascular diseases, and lower quality of life (QoL). Therefore, the aim of this study was to perform a cross-cultural adaptation and validation of the VascuQol-6 questionnaire for the Portuguese population to obtain a quick, sensitive, and easy-to-use way to assess the QoL of Portuguese patients diagnosed with PAD.

METHODS

The Vascular Quality of Life-6 Questionnaire (VascuQoL-6) was adapted and translated into European Portuguese using standard validation methodology, including 115 patients with a mean age of 64.67 (7.23) years, with PAD with IC stable for more than three months; and ABI < 0.9 at rest. VascuQoL-6, SF-36, International Physical Activity Questionnaire (IPAQ), and the PAD Knowledge Questionnaire (PADKQ) were used. Reliability, construct validity analysis through convergent and discriminant validity, known-group validity, and responsiveness analysis were tested.

RESULTS

The Cronbach's alpha was 0.64 and the average inter-item correlation was 0.27, indicating acceptable internal consistency. VascuQoL-6 was positively associated with SF-36 Physical Component Summary and Mental Component Summary scores (r = 0.64, p < 0.01 and r = 0.42, p < 0.01, respectively). In turn, there was no significant correlation between VascuQoL-6 scores and the PADKQ or IPAQ. A statistically significant difference between groups according to IC severity [F(2.47) = 8.35, p < 0.001] was found. A paired samples t-test showed differences between VascuQol-6 scores before a walking program (M = 15.65, SD = 3.09), and after a walking program (M = 17.41, SD = 2.71), t(67) = 3.94, p ≤ 0.001.

CONCLUSION

The VascuQoL-6 is a six-item instrument to assess the QoL associated with PAD with good psychometric properties, convergent and discriminant validity with SF-36, PADKQ and IPAQ. The instrument proved to have known group validity and responsiveness.

Comparison of Responsiveness of Patient-Reported Outcome Measures After Total Knee Arthroplasty

BACKGROUND

The aim of this study was to evaluate the responsiveness of different patient-reported outcome measures in patients with primary total knee arthroplasty (TKA).

METHODS

In this prospective observational study, we assessed patients with TKA before the surgery, after 4 months, after 1 year, and after 2 years. Measures were the objective Knee Society Score (KSS) and the following patient-reported outcome measures: Knee injury and Osteoarthritis Outcome Score (KOOS), KOOS-12, Forgotten Joint Score (FJS-12), High-Activity Arthroplasty Score, and EQ-5D-3L. Responsiveness was determined by effect size (ES), standardized response mean (SRM), area under the receiver operating characteristics curve, floor and ceiling effects, and hypothesis testing.

RESULTS

We analyzed data from 309 TKAs (272 patients, 56% female). The ES and SRM for the change in KSS, KOOS, KOOS-12, FJS-12, and EQ-5D-3L from baseline to each follow-up were large (>0.8). The largest responsiveness from baseline to follow-up was found for the KSS, KOOS/KOOS-12 quality of life, KOOS-12 summary, KOOS-12 pain, and FJS-12 (2.0 > ES <3.9, 1.4 > SRM <2.4). The area under the curve from baseline to each follow-up was ≥0.7 for KOOS, KOOS-12, and FJS-12 (range 0.71 to 0.95) and <0.7 for KSS and EQ-5D-3L (range 0.65 to 0.74). We found floor or ceiling effects in the KOOS, KOOS-12, and EQ-5D-3L, but not in the KSS, FJS-12, and High-Activity Arthroplasty Score.

CONCLUSIONS

Our study demonstrated that responsiveness differed between the various measures. The KOOS-12 and FJS-12 showed the greatest internal and external responsiveness, although ceiling effects occurred in the KOOS-12.

Guidelines for the development and validation of patient-reported outcome measures: a scoping review

OBJECTIVE

The objectives of this scoping review were to provide an overview of existing guidelines for the development and validation of patient-reported outcome measures (PROMs), review them for comprehensiveness and clarity and provide recommendations for their use based on the goals of the instrument developers.

DESIGN

Scoping review.

METHODS

A literature search was performed in PubMed, Scopus, PsycInfo and Google Scholar up to 2 June 2023 to identify guidelines for the development and validation of PROMs. Screening of records and reports as well as data extraction were performed by two reviewers. To assess the comprehensiveness of the included guidelines, a mapping synthesis was performed and steps to develop and validate a measurement instrument outlined in the included guidelines were mapped to an a priori framework including 20 steps, which was based on the guideline by de Vet et al.

RESULTS

A total of 40 guidelines were included. Statistical advice (at least partially) was provided in 98% of the guidelines (39/40) and 88% (35/40) of the guidelines included examples for steps required to develop and validate PROMs. However, 78% (31/40) of the guidelines were not comprehensive and two essential steps in PROM development ('consideration and elaboration of the measurement model' and 'responsiveness') were not included in 80% and 72% of the guidelines, respectively. Three guidelines included all 20 steps and six included almost all steps (≥90% of steps) for developing and validating a PROM.

DISCUSSION

Most guidelines on PROM development and validation do not appear to be comprehensive, and some crucial steps are missing in most guidelines. Nevertheless, for some purposes of PROMs, many guidelines provide helpful advice and support.

CONCLUSION

At least 15 guidelines may be recommended, including three comprehensive guidelines that can be recommended for the development and validation of PROMs for most purposes (eg, to discriminate between subjects with a particular condition and subjects without that condition, to evaluate the effects of treatments (between a pre and post time-points) or to evaluate a status quo).

Responsiveness and construct validity of two outcome measures of bilateral upper limb function in patients with chronic stroke

Background

Stroke is a leading cause of long-term disability among stroke survivors. Despite the availability of numerous stroke rehabilitative therapies, such as mirror therapy, bilateral arm training, and robot-assisted therapy, the recovery of motor function after stroke remains incomplete. Bilateral arm function is a key component in stroke patients to perform activities of daily living and to reflect their functional autonomy.

Objective

This clinimetric study investigated and compared the construct validity and responsiveness of 2 bimanual activity outcome measures, the Chedoke Arm and Hand Activity Inventory (CAHAI) and the ABILHAND Questionnaire, in individuals receiving stroke rehabilitation.

Methods

The present study is a secondary analysis following the framework of the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN). Individuals with chronic stroke (N = 113) were recruited from outpatient rehabilitation settings. Participants received 18 to 20 sessions of robot-assisted therapy, mirror therapy, combined therapy, or conventional rehabilitation for 4 to 6 weeks. The CAHAI, ABILHAND Questionnaire, and a comparison instrument, the Motor Activity Log (MAL), were administered twice at a 4- to 6-week interval to all participants. ABILHAND scores, in logits, were converted from raw ordinal scores into a linear measure.

Results

There was medium to large correlation of the CAHAI and the MAL (ρ = 0.60-0.62, p < 0.01) as well as the ABILHAND Questionnaire and the MAL (ρ = 0.44-0.51, p < 0.01). Change scores from the initial measurement to the post-intervention measurement demonstrated small to medium correlation of the CAHAI and the MAL (ρ = 0.27-0.31, p < 0.01) and medium to large correlation of the ABILHAND Questionnaire and the MAL (ρ = 0.37-0.41, p < 0.01). Overall, 7 of 8 hypotheses were supported. The hypothesis testing regarding the construct validity and responsiveness of the CAHAI and ABILHAND Questionnaire was confirmed.

Conclusion

The CAHAI and ABILHAND Questionnaire are both responsive and suitable to detect changes in bilateral arm functional daily activities in individuals with chronic stroke. Patient-reported outcome measures are recommended to use along with therapist-rated outcome measures for upper limb capacity evaluation in stroke rehabilitation. Further study with a prospective study design to capture specific clinical features of participants and the use of body-worn sensors, such as the arm accelerometer, is suggested.

Content Validity and Psychometric Properties of the German Version of the Holm and Cordoba Urinary Tract Infection Score for Uncomplicated Urinary Tract Infections in Women: Protocol for a Validation Study

BACKGROUND

Uncomplicated urinary tract infections (UTIs) in women are among the most common bacterial infections in primary care. Given the health threats related to the overuse of antibiotics, alternative options are of increasing importance. Patient-reported outcome measures are valuable tools for including the patients' perspective when evaluating the efficacy of these strategies. Aiming to identify a suitable instrument to measure the severity and bothersomeness of UTI symptoms in women, we performed a systematic review of the literature and identified the Holm and Cordoba Urinary Tract Infection Score (HCUTI), which measures the severity, bothersomeness, and impact of uncomplicated UTIs on daily activities. This instrument showed sufficient content validity but needs translation and further validation before it can be used in German research.

OBJECTIVE

For use in the German setting, we aim (1) to perform translation and linguistic validation of the HCUTI and (2) to evaluate content validity and psychometric properties of the German version of the HCUTI in a population of women with uncomplicated UTIs.

METHODS

The HCUTI will be translated and linguistically validated using the dual-panel method. This process involves a bilingual translation panel and a lay panel to check the comprehensibility of the translation. Content validity of the translated questionnaire will be assessed using cognitive interviews according to the criteria for good content validity as recommended by the COSMIN (Consensus-based Standards for the selection of health Measurement Instruments) group involving women with uncomplicated UTIs and health care professionals. Subsequent psychometric validation of the German version of the HCUTI in a population of women with uncomplicated UTIs will include the assessment of structural validity, internal consistency, test-retest reliability, construct validity, responsiveness, and interpretability.

RESULTS

Results of the translation and linguistic validation process and the results of the content validity study were obtained in September 2023 and will be published separately. Data on the psychometric properties of the German version of the HCUTI are anticipated in mid-2024.

CONCLUSIONS

We expect that data from the content validity study will provide important suggestions for potential modifications of the HCUTI for use in the German setting. The final version of the questionnaire will be used for the assessment of its psychometric properties in a large population of women with uncomplicated UTIs.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/49903.

Refinement and revalidation of the Equine Ophthalmic Pain Scale: R-EOPS a new scale for ocular pain assessment in horses

This study addresses the refinement and revalidation of a composite pain scale that focuses on equine facial expressions and behavioural indicators as exhibitions of ophthalmic pain. This scale included only Behavioural and Facial and Ocular expression indicators and, compared to the first version of Equine Ophthalmic Pain Scale (EOPS), item descriptors and related ratings were changed. Thirteen horses with ocular diseases that required medical or surgical treatment were enroled (group P). In each animal, the refined EOPS (R-EOPS) was applied prior to any treatment (T0) and one week later (T7). The R-EOPS was applied twice, 7 days apart, to 16 healthy control horses (group C). Two 30-second videos were recorded each time to allow the retrospective analysis by eight observers. Inter-observer reliability of items was moderate or substantial (Krippendorff's alpha, Kα>0.40) while their intra-observer reliability was substantial or almost perfect for most items (Kα ≥0.61). Both inter- and intra-observer reliability of Total Score (TS) were however excellent (Intraclass Correlation Coefficients, ICC>0.75). The TS also showed good reproducibility (Kendall coefficient=0.786, ICC=0.684) and high consistency of its items (Cronbach's α=0.847). The comparison between groups as well as the sensitivity and specificity values supported the validity of the R-EOPS. In particular, for each extra point added to the TS, the risk of the horse having pain increased by more than two times (Odds Ratio=2.079, 95%CI=1.542-2.804; P<0.001). The Receiver Operating Characteristic analysis identified 6 as the threshold value of R-EOPS for discriminating horses with ocular pathology (sensitivity=83%, specificity=100%). This scale may be an effective tool for reliably assessing the pain level in horses with ophthalmic diseases and potentially guiding pain management although it still requires large-scale application and external validation.

Responsiveness and minimal important change of the Family Reported Outcome Measure (FROM-16)

BACKGROUND

The FROM-16 is a generic family quality of life (QoL) instrument that measures the QoL impact of patients' disease on their family members/partners. The study aimed to assess the responsiveness of FROM-16 to change and determine Minimal Important Change (MIC).

METHODS

Responsiveness and MIC for FROM-16 were assessed prospectively with patients and their family members recruited from outpatient departments of the University Hospital Wales and University Hospital Llandough, Cardiff, United Kingdom. Patients completed the EQ-5D-3L and a global severity question (GSQ) online at baseline and at 3-month follow-up. Family members completed FROM-16 at baseline and a Global Rating of Change (GRC) in addition to FROM-16 at follow-up. Responsiveness was assessed using the distribution-based (effect size-ES, standardized response mean -SRM) and anchor-based (area under the receiver operating characteristics curve ROC-AUC) approaches and by testing hypotheses on expected correlation strength between FROM-16 change score and patient assessment tools (GSQ and EQ-5D). Cohen's criteria were used for assessing ES. The AUC ≥ 0.7 was considered a good measure of responsiveness. MIC was calculated using anchor-based (ROC analysis and adjusted predictive modelling) and distribution methods based on standard deviation (SD) and standard error of the measurement (SEM).

RESULTS

Eighty-three patients with 15 different health conditions and their relatives completed baseline and follow-up questionnaires and were included in the responsiveness analysis. The mean FROM-16 change over 3 months = 1.43 (SD = 4.98). The mean patient EQ-5D change over 3 months = -0.059 (SD = 0.14). The responsiveness analysis showed that the FROM-16 was responsive to change (ES = 0.2, SRM = 0.3; p < 0.01). The ES and SRM of FROM-16 change score ranged from small (ES = 0.2; SRM = 0.3) for the distribution-based method to large (ES = 0.8, SRM = 0.85) for anchor-based methods. The AUC value was above 0.7, indicating good responsiveness. There was a significant positive correlation between the FROM-16 change scores and the patient's disease severity change scores (p < 0.001). The MIC analysis was based on data from 100 family members of 100 patients. The MIC value of 4 was suggested for FROM-16.

CONCLUSIONS

The results of this study confirm the longitudinal validity of FROM-16 which refers to the degree to which an instrument is able to measure change in the construct to be measured. The results yield a MIC value of 4 for FROM-16. These psychometric attributes of the FROM-16 instrument are useful in both clinical research as well as clinical practice.

Spanish validation of the short version of the racing and crowded thoughts questionnaire (RCTQ-13)

BACKGROUND

The Racing and Crowded Thoughts Questionnaire (RCTQ-13) is the most widely used specific scale for the measurement of racing thoughts, but there is currently no Spanish version that allow the evaluation in Spanish-speaking patients. The objective of this study is to translate, adapt, and validate the RCTQ-13 in a Colombian population with affective disorders.

METHODS

The questionnaire was translated and back-translated, and corrections were implemented following a pilot test to improve comprehensibility. We included patients with Bipolar I Disorder and with Major depressive disorder seen in three centers in the city of Medellín, Colombia. We evaluate structural validity with confirmatory factor analysis, internal consistency, and test-retest reliability. Construct validity was also assessed with the comparison between euthymic, maniac, and depressive episodes and the correlation with worry, rumination, and mania scales. Responsiveness was measured 1 month after the first evaluation. Based on item response theory (IRT), we also estimated item difficulty, discrimination, and fit using a generalized partial credit model.

RESULTS

Two hundred fifty subjects were included. Confirmatory factor analysis revealed that the three-factor structure of the scale was appropriate. Internal consistency was adequate for the entire scale (Cronbach's alpha = 0.95, 95% CI: 0.94-0.96) and for each factor. Test-retest reliability was good (intraclass correlation coefficient = 0.82, 95%IC: 0.70-0.88). For construct validity, we observed differences between patients with different types of affective episodes, a moderate positive correlation with the Penn State Worry Scale (r = 0.55) and the Ruminative Response Scale (r = 0.42), and a low negative correlation with the Young Mania Rating Scale (r = - 0.10). Responsiveness was proved to be adequate. Under IRT, the response thresholds for the response options are organized for all items. The infit was adequate for all items and the outfit was acceptable.

CONCLUSIONS

The Spanish version of the RCTQ-13 is a reliable, valid, and responsive scale and can be used for the clinical assessment of the construct of racing and crowded thoughts in patients with the spectrum of affective disorders in whom this experience can be expressed with different nuances. Further research is needed to expand the relationship with rumination and worry.

The measurement properties and feasibility of FRAIL scale in older adults: A systematic review and meta-analysis

Frailty is a prevalent condition amongst older adults, significantly affecting their quality of life. The FRAIL tool has been purposefully designed for clinical application by assisting healthcare professionals in identifying and managing frailty-related issues in older adults, making it a preferred choice for assessing frailty across diverse older populations. This review aimed to synthesize the measurement properties and feasibility of FRAIL. Guided by COSMIN guidelines, seven databases were searched from inception to 31 Mar 2023. The measurement properties were extracted for quality appraisal of the populations in the studied samples. Where possible, random-effects meta-analysis and meta-regression were used for quantitative synthesis. Eighteen articles containing 273 tests were drawn from 14 different populations. We found that populations testing for criterion validity had high-quality ratings, while construct validity ratings varied based on health status and geographical region. Test-retest reliability had sufficient quality ratings, while scale agreement had sufficient ratings in only four out of 14 populations tested. Responsiveness ratings were insufficient in seven out of eight populations, with inconsistent ratings in one population. Our analysis of missing data across three articles showed a 16.3% rate, indicating good feasibility of the FRAIL. FRAIL is a feasible tool for assessing frailty of older adults in community settings, with good criterion validity and test-retest reliability. However, more research is needed on construct validity and responsiveness.

Measuring the work environment among healthcare professionals: Validation of the Dutch version of the Culture of Care Barometer

OBJECTIVES

A positive work environment (WE) is paramount for healthcare employees to provide good quality care. To stimulate a positive work environment, employees' perceptions of the work environment need to be assessed. This study aimed to assess the reliability and validity of the Dutch version of the Culture of Care Barometer (CoCB-NL) survey in hospitals.

METHODS

This longitudinal validation study explored content validity, structural validity, internal consistency, hypothesis testing for construct validity, and responsiveness. The study was conducted at seven departments in two Dutch university hospitals. The departments were included based on their managers' motivation to better understand their employees' perception of their WE. All employees of participating departments were invited to complete the survey (n = 1,730).

RESULTS

The response rate was 63.2%. The content of the CoCB-NL was considered relevant and accessible by the respondents. Two factor models were found. First, confirmative factor analysis of the original four-factor structure showed an acceptable fit (X2 2006.49; df 399; p = <0.001; comparative fit index [CFI] 0.82; Tucker-Lewis index [TLI] 0.80; root mean square error of approximation [RMSEA] 0.09). Second, explanatory factor analysis revealed a five-factor model including 'organizational support', 'leadership', 'collegiality and teamwork', 'relationship with manager', and 'employee influence and development'. This model was confirmed and showed a better fit (X2 1552.93; df 395; p = < 0.00; CFI 0.87; TLI 0.86; RMSEA 0.07). Twelve out of eighteen hypotheses were confirmed. Responsiveness was assumed between the measurements.

CONCLUSIONS

The CoCB-NL is a valid and reliable instrument for identifying areas needing improvement in the WE. Furthermore, the CoCB-NL appears to be responsive and therefore useful for longitudinal evaluations of healthcare employees' work environments.

Development and validation of the genitourinary syndrome of menopause symptoms and vaginal treatments acceptability questionnaire (GSM-SVTAQ): An electronic patient-reported outcomes measure

OBJECTIVES

To develop and validate an electronic, patient-reported outcomes measure (PROM) specific for genitourinary syndrome of menopause (GSM) patients. The PROM aimed to accurately assess the burden of GSM symptoms, their impact on health-related and sexual quality of life, and the acceptability of vaginal treatments.

METHODS

The study encompassed a comprehensive three-stage approach to the development and validation of the PROM. Initially, during the preliminary design stage, the necessity for a new PROM was recognized, an expert panel was formed, and semi-structured qualitative interviews were carried out with GSM patients. In the second stage, the study used the five-step pre-validation methodology established by Prior et al. to generate and refine the PROM items. The third and final stage encompassed the determination of scale and item content validity indexes to ensure validity. Additionally, the reliability of each construct was evaluated using Cronbach's α.

RESULTS

The resulting PROM was named GSM-SVTAQ (GSM-symptoms and vaginal treatments acceptability questionnaire). It demonstrated excellent validity in assessing symptoms burden, health-related and sexual quality of life, and vaginal treatment acceptability, with high content validity indices and strong internal consistency. The scale content validity indices and Cronbach's α coefficients for the three domains were (0.926, 0.939), (0.875, 0.947), and (0.824, 0.855), respectively.

CONCLUSION

The GSM-SVTAQ stands as the first GSM-specific, valid, and reliable PROM capable of comprehensively measuring the three components of GSM and the acceptability of vaginal treatments. Its implementation has the potential to significantly enhance patient care and outcomes in GSM management.

Transcultural adaptation and validation of a Korea version of Pedi-IKDC questionnaire

BACKGROUND

This study aimed to translate and transculturally adapt the English version of the Pedi-IKDC questionnaire into Korean and evaluate the psychometric properties of the Korean Pedi-IKDC questionnaire in terms of internal consistency, feasibility (floor and ceiling effect), construct validity, test-retest reliability, and factor analysis.

METHODS

The original English version of the Pedi-IKDC questionnaire was translated and transculturally adapted into Korean according to established guidelines. A total of 239 patients aged 7-18 years who visited the hospital because of knee pain or discomfort were considered eligible for the study. These patients completed the Korean version of the Pedi-IKDC and Pediatric Quality of Life questionnaires (PedsQL). The correlation between the PedsQL and Pedi-IKDC questionnaires was assessed to confirm the validity of the questionnaire. To verify the validity of the Korean Pedi-IKDC questionnaire, internal consistency, feasibility, test-retest reliability, and construct validity were evaluated, and a factor analysis was performed.

RESULTS

Internal consistency was found to be satisfactory in all subscales (Cronbach's alpha ≥ 0.7). The test-retest reliability was satisfactorily high for all subscales (Intraclass correlation coefficient: 0.81-0.84). A high correlation was observed between the total Pedi-IKDC score and the score on the physical-health subscale of child version of the PedsQL (Correlation coefficients: 0.720). There were no floor effects in all subscales, but ceiling effects were observed in four questions. Additionally, factor analysis suggested that the questionnaire could be divided into two subscales.

CONCLUSION

The Korean version of the Pedi-IKDC questionnaire was successfully translated and transculturally adapted according to the established guidelines. The Korean Pedi-IKDC questionnaire has been proven reliable and valid.

Health-related quality of life and experience measures, to assess patients' experiences of peripheral intravenous catheters: a secondary data analysis

BACKGROUND

Peripheral intravenous catheters (PIVCs) are essential for successful administration of intravenous treatments. However, insertion failure and PIVC complications are common and negatively impact patients' health-outcomes and experiences. We aimed to assess whether generic (not condition-specific) quality of life and experience measures were suitable for assessing outcomes and experiences of patients with PIVCs.

METHODS

We undertook a secondary analysis of data collected on three existing instruments within a large randomised controlled trial, conducted at two adult tertiary hospitals in Queensland, Australia. Instruments included the EuroQol Five Dimension - Five Level (EQ5D-5L), the Functional Assessment of Chronic Illness Therapy - Treatment Satisfaction - General measure (FACIT-TS-G, eight items), and the Australian Hospital Patient Experience Question Set (AHPEQS, 12 items). Responses were compared against two clinical PIVC outcomes of interest: all-cause failure and multiple insertion attempts. Classic descriptives were reported for ceiling and floor effects. Regression analyses examined validity (discrimination). Standardised response mean and effect size (ES) assessed responsiveness (EQ5D-5L, only).

RESULTS

In total, 685 participants completed the EQ5D-5L at insertion and 526 at removal. The FACIT-TS-G was completed by 264 and the AHPEQS by 262 participants. Two FACIT-TS-G items and one AHPEQS item demonstrated ceiling effect. Instruments overall demonstrated poor discrimination, however, all-cause PIVC failure was significantly associated with several individual items in the instruments (e.g., AHPEQS, 'unexpected physical and emotional harm'). EQ5D-5L demonstrated trivial (ES < 0.20) responsiveness.

CONCLUSIONS

Initial investigation of an existing health-related quality of life measure (EQ5D-5L) and two patient-reported experience measures (FACIT-TS-G; AHPEQS) suggest they are inadequate (as a summary measure) to assess outcomes and experiences for patients with PIVCs. Reliable instruments are urgently needed to inform quality improvement and benchmark standards of care.

Developing standards for MRI evaluation of joints in children with juvenile idiopathic arthritis utilizing the temporomandibular joint as a model

The treatment of a patient with juvenile idiopathic arthritis (JIA) is best monitored with standardized and validated tools to measure joint changes over time. Treatment approaches are best indicated if the clinicians are aware of the structural status of the joint at a given time, especially in anatomically deep joints for which clinical assessment is limited. Magnetic resonance imaging (MRI) is of utmost importance for assessment of deep joints and extra-articular soft tissue of the entire body for which ultrasound may be suboptimal. Because the distinction between pathologic and physiologic joint changes on MRI is key for proper diagnosis and treatment of patients with arthropathies, a comprehensive standardized approach is needed to effectively measure outcomes of growing joints of children with JIA. Such an approach is essential for both clinical assessment and to conduct clinical trials in patients with JIA treated in different centers around the world. To meet this need, several international imaging collaborative research groups have been developing MRI scales over the past years, including the MRI in JIA (JAMRI) special interest group within the Outcome Measures in Rheumatology (OMERACT) research network. This manuscript reviews the efforts of the OMERACT JAMRI working group to generate and validate pediatric MRI scoring systems for different joints in children with JIA that can have ubiquitous utilization anywhere in the world. In particular, it describes the different steps of development and validation of an MRI scale using the TMJ as a model.

Construct validity, responsiveness, and interpretability of the Utrecht Scale for Evaluation of Rehabilitation (USER) in patients admitted to inpatient geriatric rehabilitation

OBJECTIVE

The Utrecht Scale for Evaluation of Rehabilitation is a multi-domain measurement with good content validity, structural validity and reliability for measuring physical functioning (mobility, selfcare) and cognitive functioning in geriatric rehabilitation. We aimed to determine the construct validity of both Utrecht Scale for Evaluation of Rehabilitation scales and the responsiveness and interpretability of the scale for physical functioning in geriatric rehabilitation.

DESIGN

Prospective follow-up study embedded in routine care.

SETTING

Four care organisations in The Netherlands.

SUBJECTS

Patients admitted for inpatient geriatric rehabilitation (2021-2022).

MAIN MEASURES

Data collection included the Utrecht Scale for Evaluation of Rehabilitation, Mini-Mental State Examination, Barthel index, and a global rating scale anchor on recovery. Hypothesis testing was used to determine construct validity and responsiveness. For interpretability, minimal important change and floor and ceiling effects were determined.

RESULTS

The mean age of participants (n = 211) was 77 (SD 10.4). Their mean length of stay was 38.6 days (SD 26.3), and 81% returned home. The Utrecht Scale for Evaluation of Rehabilitation showed adequate construct validity, as all three hypotheses were confirmed for both scales. The Utrecht Scale for Evaluation of Rehabilitation-physical function scale showed adequate responsiveness, with all five hypotheses confirmed. The mean change for physical function (scale range 0-70) was 15.5 points (SD 17.1). The minimal important change for Utrecht Scale for Evaluation of Rehabilitation-physical function was 14.5 points difference for improvement. This scale showed no floor (2%) and ceiling effects (14%) at admission and discharge.

CONCLUSIONS

The Utrecht Scale for Evaluation of Rehabilitation showed to be effective for evaluating physical functioning during geriatric rehabilitation as well as screening cognitive functioning. In total, 14.5 points difference has been established as a minimal important change for physical functioning.

Design and Validation of a Questionnaire to Measure Interprofessional Collaborative Practice for Auditing Integrated Hospital Care: Empirical Research

INTRODUCTION

Interprofessional teamwork is the key issue of delivering integrated hospital care; however, measuring interprofessional collaboration for auditing is fragmented. In this study, a questionnaire to measure InterProfessional collaborative Practice for Integrated Hospital care (IPPIH) has been developed and validated.

METHODS

A four-step iterative process was conducted: (1) literature search to find suitable questionnaires; (2) semistructured stakeholder interviews (individual and in focus groups) to discuss the topics and questions (face validity), (3) pretesting the prototype of the questionnaire in two different integrated care pathways for feasibility, usability, and internal consistency, and (4) testing (content and construct validity and responsiveness) of the revised questionnaire in eight integrated care pathways; the validation and responsiveness was tested by means of exploratory factor analysis, calculation of Cronbach alpha, item analysis, and linear mixed model analysis.

RESULTS

Based on six questionnaires and the opinion of direct stakeholders, the questionnaire IPPIH comprised 27 items. Five different domains could be distinguished: own skills, culture, coordination and collaboration, practical support, and appreciation with the Cronbach alpha varied from 0.91 to 0.48. The self-reported intensity of the collaboration within a specific care pathway significantly influenced the outcome (P = .000).

CONCLUSION

The product is a questionnaire, IPPIH, which can measure the degree of interprofessional collaborative practice in integrated hospital care pathways. The IPPIH was initially developed for quality assurance. However, the IPPIH also seems to be suitable as a self-assessment tool for directors to monitor and improve the interprofessional collaboration and the quality of their integrated care pathway.

The Stroke Upper and Lower Extremity Physical Function Measures Were Supported for Score Reliability, Validity, and Administration Efficiency for Patients Poststroke

OBJECTIVE

The aims of this study were to (1) evaluate the suitability of newly developed items for calibration into 2 item banks for stroke upper extremity (SUE) and stroke lower extremity (SLE) physical function (PF) patient-reported outcome measures (PROMs) and to (2) assess score reliability and validity and PROM administration efficiency based on computerized adaptive testing (CAT).

METHODS

A retrospective longitudinal study involving patients poststroke who were treated in outpatient rehabilitation clinics and responded to 28 and 25 region-specific candidate items addressing tasks related to upper or lower extremity PF, respectively, was conducted. Item response theory (IRT) model assumptions of unidimensionality, local independence, item fit, and presence of differential item functioning were evaluated. CAT-generated scores were assessed for reliability, validity, and administration efficiency, and 10-item short forms were assessed for reliability.

RESULTS

Cohorts consisted of 2017 patients with stroke involving the upper extremity and 2107 patients with stroke involving the lower extremity (mean age [SD]: SUE = 62 [14] and SLE = 63 [14]; range = 14-89). Two solutions (SUE: 28-item; SLE: 24-item) supported unidimensionality and fit to the IRT model, with reliability estimates >0.93 for all administration modes. No items demonstrated differential item functioning. Scores discriminated among multiple patient groups in clinically logical ways, with better outcomes observed for patients who were younger, were male, had less chronicity, and had fewer comorbidities. The SUE and SLE, respectively, had 1 and 0.3% floor effects and 4.3 and 1.1% ceiling effects. Change score effect sizes were 0.5 (SUE) and 0.6 (SLE). Simulated CAT scores required an average of 6 (SUE) and 5.6 (SLE) items (median = 5).

CONCLUSION

The stroke upper extremity and stroke lower extremity PROM scores were reliable, valid, and efficient and had moderate change effect sizes for assessing PF as perceived by patients poststroke with upper and lower extremity impairments. Scores had negligible floor and acceptable ceiling effects. Based on these results, the stroke PROMs are suitable for research and routine clinical practice.

IMPACT

As IRT-based measures, these PROMs support clinical practice guideline recommendations for the use of outcome measures in neurologic physical therapy and the administration of condition-specific functional questions with low response burden for patients. The 10-item short forms offer a feasible alternative administration mode when CAT administration is not available.

Responsiveness and Minimal Clinically Important Difference of the Infants and Toddlers Dermatology Quality of Life Questionnaire

BACKGROUND

The Infants and Toddlers Dermatology Quality of Life (InToDermQoL) is the dermatology-specific proxy health-related quality of life (HRQoL) instrument for children from birth to 4 years. The aim of the present study was to confirm the responsiveness and establish minimal clinically important difference (MCID) for the InToDermQoL.

METHODS

Parents of children with skin diseases were asked to fill in the InToDermQoL at the initial visit (T1) and subsequent consultation (T2). We hypothesized that correlations between change scores of the InToDermQoL and change scores of global assessment of clinical severity by dermatologists and by patients' parents should be above 0.3. The receiver operating characteristic (ROC) curves method was also used for confirmation of responsiveness and determination of MCIDs of the InToDermQoL. The area under the ROC curve (AUC) was used as an indicator of responsiveness.

RESULTS

Results of 442 patients were included. Correlations between change scores of age-specific versions of the InToDermQoL and change scores of global assessment of clinical severity by dermatologists and by patients' parents were above 0.3 (0.46-0.74). AUCs for age-specific versions of the InToDermQoL were acceptable (above 0.7) or excellent (above 0.8). Estimated MCIDs for the InToDermQoL were as follows: 3 points of total score change for 0-11 months, 5 for 1-2 years and 3 or 4 for 3-4 years version. Estimated MCIDs for the InToDermQoL version for 1-2-year-old children was higher than MCIDs for the 3-4-year-old version despite the higher number of items in the latter. Therefore a MCID of 5 was recommended for both these versions.

CONCLUSIONS

Responsiveness for all age-specific versions of the InToDermQoL questionnaire was confirmed. MCIDs for the InToDermQoL are proposed as follows: 3-point change of the total score for age version 0-11 months and 5-point for the age versions 1-2 years and 3-4 years.

Measurement properties of performance-based instruments for assessing mental function during activity and participation in persons with stroke: A systematic review

BACKGROUND

Various performance-based instruments exist to assess mental function after stroke and users have to select one for research or clinical practice.

OBJECTIVES

To evaluate the measurement properties of performance-based instruments to assess (any aspect of) mental function during activity and participation in persons after stroke.

MATERIAL AND METHODS

We searched in five electronic databases. COSMIN methodology was used to conduct the review. The strength of evidence was assessed using a modified GRADE approach.

RESULTS

Fifty articles were included reporting on 20 instruments assessing (1) multiple mental functions including ≥ four subdomains (2) attention, memory and executive functions, or single subdomains (3) executive functions, (4) perception, and (5) mental function of language. Highest quality evidence for sufficient results was found for some measurement properties in seven instruments. These instruments included: FIM + FAM, MPAI-4 and EFPT, MET, CBS/KF-NAP, BIT and the Scenario Test.

CONCLUSIONS

Further studies of high methodological quality are needed that evaluate the measurement properties of instruments to allow clinicians and researchers to select the most suitable performance-based measures for purpose.

SIGNIFICANCE

Results may be used to select the most suitable performance-based instrument to measure mental function during activity and participation in persons with stroke.

TRIAL REGISTRATION NUMBER

PROSPERO CRD42018086744.

Criterion Validity and Responsiveness of Estimated Cardiorespiratory Fitness Models in Patients with Inflammatory Joint Disease

Cardiorespiratory fitness (CRF) is an excellent marker of overall health. This study aimed to assess criterion validity and responsiveness of estimated CRF models (eCRF) in patients with inflammatory joint disease (IJD). CRF was measured directly as peak oxygen uptake (VO2peak) by a Cardiopulmonary Exercise Test (CPET), while one generic eCRF model (eCRFGEN) and two disease-specific eCRF models (eCRFALT and eCRFPGA) were used to estimate CRF at baseline and after 3 months in 55 Norwegian patients with IJD. Moderate correlations were observed between eCRFGEN, eCRFALT, eCRFPGA, and VO2peak at baseline (ICC 0.60, 0.64 and 0.62, respectively) and 3 months (ICC 0.62, 0.65 and 0.57, respectively). All eCRF models overestimated measured VO2peak, and there was large variability in agreement of individual measurements at baseline and at 3 months. Weak correlations were observed for responsiveness of eCRFGEN (ICC 0.39), eCRFALT (ICC 0.40) and eCRFPGA (ICC 0.39). Mean differences between change in eCRF models and change in VO2peak were small, but the wide limits of agreement exceeded the pre-defined clinically acceptable margins. The eCRF models possessed adequate ability to detect ≥3.5 mL/kg/min improvement in VO2peak. eCRF may suffice for group-level assessment, but caution is advised when applying eCRF to individual patients with IJD.

A Systematic Review on Evaluating Responsiveness of Parent- or Caregiver-Reported Child Maltreatment Measures for Interventions

Aims: Child maltreatment (CM) is a global public health and social problem, resulting in serious long-term health and socioeconomic consequences. As parents are the most common perpetrators of CM, parenting interventions are appropriate strategies to prevent CM. However, research on parenting interventions on CM has been hampered by lack of consensus on what measures are most responsive to detect a reduction in parental maltreating behaviours after parenting intervention. This systematic review aimed to evaluate the responsiveness of all current parent- or caregiver-reported CM measures. Methods: A systematic search was conducted in CINAHL, Embase, ERIC, PsycINFO, PubMed and Sociological Abstracts. The quality of studies and responsiveness of the measures were evaluated using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guidelines for systematic reviews of patient-reported outcome measures. Only measures developed and published in English were included. Studies reporting data on responsiveness of the included measures were selected. Results: Sixty-nine articles reported on responsiveness of 15 identified measures. The study quality was overall adequate. The responsiveness of the measures was overall insufficient or not reported; high-quality evidence on responsiveness was limited. Conclusions: Only the Physical Abuse subscale of the ISPCAN Child Abuse Screening Tool for use in Trials (ICAST-Trial) can be recommended as most responsive for use in parenting interventions, with high-quality evidence supporting sufficient responsiveness. All other overall scales or subscales of the 15 included measures were identified as promising based on current data on responsiveness. Additional psychometric evidence is required before they can be recommended.

The completely patient-reported version of the American Orthopaedic Foot and Ankle Society (AOFAS) score: A valid and reliable measurement for ankle osteoarthritis

BACKGROUND

The American Orthopaedic Foot and Ankle score (AOFAS) is an outcome measure for ankle and hindfoot conditions, which requires scoring from both the patients and the physician. A completely patient-reported version has been developed and used before, but its measurements properties are unknown. Our goal was to determine the measurement properties and the minimally important change (MIC) of a completely patient-reported AOFAS (PR-AOFAS) in patients with ankle osteoarthritis. Additionally, the MIC of both the PR-AOFAS and the AOFAS was estimated, which had not previously been done.

MATERIALS AND METHODS

The PR-AOFAS of 112 patients was evaluated for reliability, construct validity (using the AOFAS, Foot and Ankle Outcome Score, Ankle Osteoarthritis Score, Visual Analogue Scale, and Short Form-36), and responsiveness. The MIC was estimated using the optimal cut-off point of the receiver operating characteristic curve. This was a substudy of a randomized clinical trial on the efficacy of platelet-rich plasma injections for ankle osteoarthritis (OA).

RESULTS

The PR-AOFAS had sufficient construct validity, internal consistency, test-retest reliability, and responsiveness. The smallest detectable change at group level was 2.34. The MIC was 6.5 points (95% confidence interval: 0.6-14.4).

CONCLUSIONS

The measurement properties of the Dutch PR-AOFAS were sufficient in patients with ankle osteoarthritis who are willing to participate in a trial on injection therapy. The minimally important change of the PR-AOFAS is smaller than its smallest detectable change, making it more suitable for use in groups of patients, such as a research setting.

LEVEL OF CLINICAL EVIDENCE

1.

Measurement properties of a computer adaptive device, the Senscoordination 3D Cervical Trainer, to assess cervical range of motion in people with neck pain

INTRODUCTION

Clinicians commonly assess cervical range of motion (ROM) in patients with neck pain. Recently, a new instrument has been developed, the Senscoordination 3D Cervical Trainer (SCT), designed to measure neck ROM in addition to joint position error, static and dynamic balance performance, and performance on a 'neuro muscular control test'. This study aims to assess the interrater reliability, concurrent validity, and responsiveness of the SCT using the CROM device as a comparator.

METHODS

One hundred patients with non-specific neck pain were included and their active cervical ROM was measured in a random order by two raters in succession using both devices simultaneously at baseline and after personalised physiotherapy management, at 12 week follow up. Convergent validity and responsiveness were quantified by a Pearson correlation coefficient. The intraclass correlation coefficient (ICC) was used to calculate the test-retest reliability of the SCT. The smallest detectable change (SDC) was calculated per movement direction and for the total range of motion.

RESULTS

The correlation between the measures obtained with the CROM device and the SCT was high (0.97 or 0.98 depending on direction of movement). Interrater reliability was high for all directions (ICC ranging from 0.81 to 0.97). The SDC ranged from 6.9 for left cervical rotation to 12.2 for right cervical rotation. At the follow up, correlation between the change score on the CROM device and the SCT was high (0.86-0.94 depending on the direction of movement).

CONCLUSION

The SCT is a valid, reliable and responsive instrument for measuring cervical ROM.

Responsiveness of the Patient-Reported Outcome Measure-Haemorrhoidal Impact and Satisfaction Score in patients with haemorrhoidal disease

AIM

In this study we aimed to assess the responsiveness of the symptom score of the recently developed Patient-Reported Outcome Measure-Haemorrhoidal Impact and Satisfaction Score (PROM-HISS). Furthermore, the minimally relevant difference (MRD) was determined.

METHOD

The responsiveness of PROM-HISS was tested using a criterion-based (i.e. anchor) and construct-based (i.e. hypotheses testing) approach. Patients with haemorrhoidal disease (HD) completed the PROM-HISS before and 1 week after treatment in hospital. A global self-assessment of change question (SCQ) was administered 1-week after treatment and functioned as the criterion. The following analyses were performed: (1) correlation between the PROM-HISS symptom score and the criterion (SCQ) and (2) hypotheses testing. The MRD was determined as change in symptoms of the subgroup reporting 'somewhat fewer complaints' on the SCQ.

RESULTS

Between February and August 2022, 94 patients with grade II-IV HD from three hospitals were included. The correlation between the SCQ and a change on the PROM-HISS symptom score was 0.595 indicating that an improvement on the SCQ corresponds to an improvement on the PROM-HISS symptom score. As hypothesized, the mean change in PROM-HISS scores was significantly different between subgroups of patients based on their SCQ responses. Patients reporting a small change in HD symptoms on the SCQ corresponded to a mean change of 0.3 on the PROM-HISS symptom score.

CONCLUSION

The PROM-HISS symptom score is a responsive instrument as it identifies change in HD symptoms because of treatment. The estimated MRD of 0.3 can be used to inform clinical research and practice.

To evaluate responsiveness and minimal important change (MIC) for the Persian versions of FABQ, TSK, and PCS

INTRODUCTION

Fear avoidance beliefs questionnaire (FABQ), Tampa scale of kinesiophobia (TSK), and pain catastrophizing scale (PCS) are tools widely used to measure fear-avoidance beliefs, fear of movement, and pain-related catastrophic thinking in people with chronic spinal disorders.

PURPOSE

To evaluate responsiveness and minimal important change (MIC) for the Persian version of FABQ, TSK, and PCS.

METHOD

One hundred people with chronic non-specific neck pain participated in an intervention program including routine physiotherapy plus pain neuroscience education. They fulfilled FABQ, TSK, and PCS questionnaires at baseline and 4-week follow-up. The 7-point global rating of change (GRC) as the external anchor was also completed in follow-up by patients. Responsiveness was evaluated using receiver operating characteristic (ROC) curve analysis and correlation analysis. According to GRC, patients were classified into two groups (improved vs. unimproved). The best cutoff or MIC was estimated via the ROC curve.

RESULTS

Acceptable responsiveness obtained for FABQ, TSK, and PCS with the area under the curve ranging from 0.84 to 0.94 and spearman coefficient > 0.6. The MIC values reflecting improvement were 9.5, 10.5, and 12.5 points, respectively, for FABQ, TSK, and PCS.

CONCLUSIONS

The results of this study demonstrated that the Persian version of FABQ, TSK, and PCS have sufficient responsiveness and good ability to measure meaningful clinical changes in people with patient CNNP. The MIC scores of the FABQ, TSK, and PCS can help clinicians and researchers to detect changes significant to the patient following a rehabilitation program.

Responsiveness of the Indonesian Versions of the Anterior Cruciate Ligament-Return to Sport After Injury Score, the International Knee Documentation Committee Subjective Knee Form, and the Lysholm Score in Patients With ACL Injury

Background

The Indonesian versions of the Anterior Cruciate Ligament-Return to Sport after Injury (ACL-RSI), International Knee Documentation Committee subjective knee form (IKDC), and the Lysholm scores are considered valid and reliable for Indonesian-speaking patients with anterior cruciate ligament (ACL) injury.

Purpose/Hypothesis

The purpose of this study was to determine the responsiveness of the ACL-RSI, IKDC, and Lysholm scores in an Indonesian-speaking population with ACL injury. It was hypothesized that they would have good responsiveness.

Study Design

Cohort study (diagnosis); Level of evidence, 2.

Methods

Between March 1, 2021, and February 28, 2022, patients with an ACL injury at a single hospital in Indonesia were asked to complete the ACL-RSI, IKDC, and Lysholm scores before either reconstruction surgery or nonoperative treatment. At 6 months after treatment, the patients completed all 3 scores a second time, plus a global rating of change question. The distribution-based and the anchor-based methods were used to study responsiveness. For each scale, the standardized response mean, minimal clinically important difference (MCID), and minimal detectable change (MDC; at the group [MDCgr] and individual [MDCind] levels) for each scale were determined.

Results

Of 80 eligible patients, 75 (93.8%) completed the study. The standardized response means for the ACL-RSI, IKDC, and Lysholm scores were 1.59, 1.72, and 1.51, respectively, indicating good responsiveness. The MCIDs for the ACL-RSI, IKDC, and Lysholm scores were 6.8, 7.8, and 4.8, respectively; all MCIDs were larger than that of the MDCgr (1.1, 0.7, and 0.6, respectively). At the individual level, the MCID for the IKDC was larger than the MDCind (7.8 vs 5.8). However, the MCIDs for ACL-RSI and Lysholm scores were smaller than those of the MDCind (6.8 vs 10.9 and 4.8 vs 5.1, respectively).

Conclusion

The Indonesian ACL-RSI, IKDC, and Lysholm scores indicated good responsiveness and can be used in the follow-up of patients after ACL injury, especially at the group level. In individual patients, IKDC was found to be more efficient than the ACL-RSI or Lysholm scores for detecting clinically important changes over time after ACL treatment.

A novel eye-movement impairment in multiple sclerosis indicating widespread cortical damage

In multiple sclerosis, remyelination trials have yet to deliver success like that achieved for relapse rates with disease course modifying treatment trials. The challenge is to have a clinical, functional outcome measure. Currently, there are none that have been validated, other than visual evoked potentials in optic neuritis. Like vision, quick eye movements (saccades) are heavily dependent on myelination. We proposed that it is possible to extrapolate from demyelination of the medial longitudinal fasciculus in the brainstem to quantitative assessment of cortical networks governing saccadic eye movements in multiple sclerosis. We have developed and validated a double-step saccadic test, which consists of a pair of eye movements towards two stimuli presented in quick succession (the demonstrate eye movement networks with saccades protocol). In this single-centre, cross-sectional cohort study we interrogated the structural and functional relationships of double-step saccades in multiple sclerosis. Data were collected for double-step saccades, cognitive function (extended Rao's Brief Repeatable Battery), disability (Expanded Disability Status Scale) and visual functioning in daily life (National Eye Institute Visual Function Questionnaire). MRI was used to quantify grey matter atrophy and multiple sclerosis lesion load. Multivariable linear regression models were used for analysis of the relationships between double-step saccades and clinical and MRI metrics. We included 209 individuals with multiple sclerosis (mean age 54.3 ± 10.5 years, 58% female, 63% relapsing-remitting multiple sclerosis) and 60 healthy control subjects (mean age 52.1 ± 9.2 years, 53% female). The proportion of correct double-step saccades was significantly reduced in multiple sclerosis (mean 0.29 ± 0.22) compared to controls (0.45 ± 0.22, P < 0.001). Consistent with this, there was a significantly larger double-step dysmetric saccadic error in multiple sclerosis (mean vertical error -1.18 ± 1.20°) compared to controls (-0.54 ± 0.86°, P < 0.001). Impaired double-step saccadic metrics were consistently associated with more severe global and local grey matter atrophy (correct responses-cortical grey matter: β = 0.42, P < 0.001), lesion load (vertical error: β = -0.28, P < 0.001), progressive phenotypes, more severe physical and cognitive impairment (correct responses-information processing: β = 0.46, P < 0.001) and visual functioning. In conclusion, double-step saccades represent a robust metric that revealed a novel eye-movement impairment in individuals with multiple sclerosis. Double-step saccades outperformed other saccadic tasks in their statistical relationship with clinical, cognitive and visual functioning, as well as global and local grey matter atrophy. Double-step saccades should be evaluated longitudinally and tested as a potential novel outcome measure for remyelination trials in multiple sclerosis.

Measurement Properties of the Patient-Specific Functional Scale in Rehabilitation for Patients With Stroke: A Prospective Observational Study

OBJECTIVE

This study investigated the validity, reliability, responsiveness, and interpretability of the Patient-Specific Functional Scale (PSFS) in subacute stroke rehabilitation to determine its suitability to measure patient-identified rehabilitation goals.

METHODS

A prospective observational study was designed according to the checklist from Consensus-Based Standards for Selecting Health Measurement Instruments. Seventy-one patients diagnosed with stroke were recruited in the subacute phase from a rehabilitation unit in Norway. The International Classification of Functioning, Disability and Health was used to assess the content validity. Assessment of construct validity was based on hypotheses for correlation of the PSFS and comparator measurements. We assessed reliability by calculating the Intraclass Correlation Coefficient (ICC) (3.1) and the standard error of measurement. The assessment of responsiveness was based on hypotheses for the correlation of change scores between the PSFS and the comparator measurements. A receiver operating characteristic analysis was conducted to assess responsiveness. The smallest detectable change and minimal important change were calculated.

RESULTS

Eighty percent of the PSFS items were classified as activities and participation in the International Classification of Functioning, Disability and Health, indicating satisfactory content validity. The reliability was satisfactory with an ICC of 0.81 (95% CI = 0.69-0.89). The standard error of measurement was 0.70 point, and the smallest detectable change was 1.94 points. Five of 7 hypotheses were confirmed for construct validity, and 5 of 6 were confirmed for responsiveness, indicating moderate construct validity and high responsiveness. Assessing responsiveness with a criterion approach resulted in an area under the curve of 0.74. A ceiling effect was identified for 25% of the participants 3 months after discharge. The minimal important change was estimated to be 1.58 points.

CONCLUSION

This study demonstrates satisfactory measurement properties for the PSFS in individuals undergoing inpatient stroke rehabilitation.

IMPACT

This study supports the use of the PSFS to document and monitor patient-identified rehabilitation goals in patients receiving subacute stroke rehabilitation when applied using a shared decision approach.

Responsiveness and trajectory of changes in the rating of everyday arm-use in the community and home (REACH) scale over the first-year post-stroke

OBJECTIVE

To examine the trajectory of the Rating of Everyday Arm-use in the Community and Home (REACH) scores over the first-year post-stroke, determine if REACH scores are modified by baseline impairment level and explore the responsiveness of the REACH scale through hypothesis testing.

DESIGN

Consecutive sample longitudinal study.

SETTING

Participants were recruited from an acute stroke unit and followed up at three, six, and 12 months post-stroke.

PARTICIPANTS

Seventy-three participants with upper limb weakness (Shoulder Abduction and Finger Extension score ≤ 8).

MAIN MEASURES

The REACH scale is a six-level self-report classification scale that captures how the affected upper limb is being used in one's own environment. The Fugl-Meyer Upper Limb Assessment (FMA-UL), Stroke Upper Limb Capacity Scale (SULCS), accelerometer-based activity count ratio and Global Rating of Change Scale (GRCS) were used to capture upper limb impairment, capacity, and use.

RESULTS

The following proportions of participants improved at least one REACH level: 64% from baseline to three months, 37% from three to six months and 13% from six to 12 months post-stroke. The trajectory of REACH scores over time was associated with baseline impairment. Change in REACH had a moderate correlation to change in SULCS and the GRCS but not FMA-UL or the activity count ratio.

CONCLUSIONS

Results of hypothesis testing provide preliminary evidence of the responsiveness of the REACH scale. On average, individuals with severe impairment continued to show improvement in use over the first year, while those with mild/moderate impairment plateaued and a small proportion decreased in the early chronic phase.

Adaptation and multicentre validation of a patient-centred outcome scale for people severely ill with COVID (IPOS-COV)

BACKGROUND

Patient-centred measures to capture symptoms and concerns have rarely been reported in severe COVID. We adapted and tested the measurement properties of the proxy version of the Integrated Palliative care Outcome Scale-IPOS-COV for severe COVID using psychometric approach.

METHODS

We consulted experts and followed consensus-based standards for the selection of health status measurement instruments and United States Food and Drug Administration guidance for adaptation and analysis. Exploratory Factor Analysis and clinical perspective informed subscales. We tested the internal consistency reliability, calculated item total correlations, examined re-test reliability in stable patients, and also evaluated inter-rater reproducibility. We examined convergent and divergent validity of IPOS-COV with the Australia-modified Karnofsky Performance Scale and evaluated known-groups validity. Ability to detect change was examined.

RESULTS

In the adaptation phase, 6 new items were added, 7 items were removed from the original measure. The recall period was revised to be the last 12-24 h to capture fast deterioration in COVID. General format and response options of the original Integrated Palliative care Outcome Scale were preserved. Data from 572 patients with COVID from across England and Wales seen by palliative care services were included. Four subscales were supported by the 4-factor solution explaining 53.5% of total variance. Breathlessness-Agitation and Gastro-intestinal subscales demonstrated good reliability with high to moderate (a = 0.70 and a = 0.67) internal consistency, and item-total correlations (0.62-0.21). All except the Flu subscale discriminated well between patients with differing disease severity. Inter-rater reliability was fair with ICC of 0.40 (0.3-0.5, 95% CI, n = 324). Correlations between the subscales and AKPS as predicted were weak (r = 0.13-0.26) but significant (p < 0.01). Breathlessness-Agitation and Drowsiness-Delirium subscales demonstrated good divergent validity. Patients with low oxygen saturation had higher mean Breathlessness-Agitation scores (M = 5.3) than those with normal levels (M = 3.4), t = 6.4 (186), p < 0.001. Change in Drowsiness-Delirium subscale correctly classified patients who died.

CONCLUSIONS

IPOS-COV is the first patient-centred measure adapted for severe COVID to support timely management. Future studies could further evaluate its responsiveness and clinical utility with clinimetric approaches.

Individual differences in computational psychiatry: a review of current challenges

Bringing precision to the understanding and treatment of mental disorders requires instruments for studying clinically relevant individual differences. One promising approach is the development of computational assays: integrating computational models with cognitive tasks to infer latent patient-specific disease processes in brain computations. While recent years have seen many methodological advancements in computational modelling and many cross-sectional patient studies, much less attention has been paid to basic psychometric properties (reliability and construct validity) of the computational measures provided by the assays. In this review, we assess the extent of this issue by examining emerging empirical evidence. We find that many computational measures suffer from poor psychometric properties, which poses a risk of invalidating previous findings and undermining ongoing research efforts using computational assays to study individual (and even group) differences. We provide recommendations for how to address these problems and, crucially, embed them within a broader perspective on key developments that are needed for translating computational assays to clinical practice.

Responsiveness and Minimal Important Change of the PROMIS Pain Interference Item Bank in Patients Presented in Musculoskeletal Practice

We evaluated the responsiveness of the Patient Reported Outcome Information System Pain Interference item bank in patients with musculoskeletal pain by testing predefined hypotheses about the relationship between the change scores on the item bank, change scores on legacy instruments and Global Ratings of Change (GRoC), and we estimated Minimal Important Change (MIC). Patients answered the full Dutch-Flemish V1.1 item bank. From the responses we derived scores for the standard 8-item short form (SF8a) and a CAT-score was simulated. Correlations between the change scores on the item bank, GRoC and legacy instruments were calculated, together with Effect Sizes, Standardized Response Means, and Area Under the Curve. GRoC were used as an anchor for estimating the MIC with (adjusted) predictive modeling. Of 1,677 patients answering baseline questionnaires 960 completed follow-up questionnaires at 3 months. The item bank correlated moderately high with the GRoC (Spearman's rho 0.63) and with the legacy instruments (Pearson's R ranging from .45 to .68). It showed a high ES (.97) and Standardized Response Means (.71), and could distinguish well between improved and not improved patients based on the GRoC (Area Under the Curve .77). Comparable results were found for the derived SF8a and CAT-scores. The MIC was estimated to be 3.2 (CI 2.6-3.7) T-score points. PERSPECTIVE: Our study supports the responsiveness of the PROMIS-PI item bank in patients with musculoskeletal complaints. Almost all predefined hypotheses were met (94%). The PROMIS-PI item bank correlated well with several legacy instruments which supports generic use of the item bank. MIC for PROMIS-PI was estimated to be 3.2 T-score points.

Measurement properties of performance-based instruments to assess mental function during activity and participation in persons who have survived a stroke: A systematic review protocol

BACKGROUND

A frequent consequence of stroke is impaired mental function, which often affects the ability to perform activities and participate in life situation. In occupational therapy practice, performance-based instruments during activity and participation are often used. However, it is important to assess if the instruments used are valid, reliable and responsive.

OBJECTIVE

The objective of this systematic review is to investigate measurement properties of performance-based instruments to assess mental function during activity and participation in persons who have survived stroke.

MATERIAL AND METHODS

Systematic database searches of PubMed, EMBASE, CINAHL, PsycINFO, and OTseeker will be conducted. COSMIN Risk of Bias checklist will be used to evaluate methodological quality of the included articles. Measurement properties of the included studies will be rated against criteria for good measurement properties. The overall evidence of each measurement property per instrument is graded using a modified GRADE approach.

RESULTS

Results will be presented in text and tables.

CONCLUSIONS

Conclusion will be drawn up-on the overall evidence to give recommendations on the most suitable instrument.

SIGNIFICANCE

It is expected that findings of the review will provide evidence to guide professionals in the selection of a performance-based instruments to measure mental function in practice and research.

TRIAL REGISTRATION NUMBER

PROSPERO CRD42018086744.

Reliability and Validity of UNESP-Botucatu Cattle Pain Scale and Cow Pain Scale in Bos taurus and Bos indicus Bulls to Assess Postoperative Pain of Surgical Orchiectomy

Pain assessment guides decision-making in pain management and improves animal welfare. We aimed to investigate the reliability and validity of the UNESP-Botucatu cattle pain scale (UCAPS) and the cow pain scale (CPS) for postoperative pain assessment in Bos taurus (Angus) and Bos indicus (Nelore) bulls after castration.

METHODS

Ten Nelore and nine Angus bulls were anaesthetised with xylazine-ketamine-diazepam-isoflurane-flunixin meglumine. Three-minute videos were recorded at -48 h, preoperative, after surgery, after rescue analgesia and at 24 h. Two evaluators assessed 95 randomised videos twice one month apart.

RESULTS

There were no significant differences in the pain scores between breeds. Intra and inter-rater reliability varied from good (>0.70) to very good (>0.81) for all scales. The criterion validity showed a strong correlation (0.76-0.78) between the numerical rating scale and VAS versus UCAPS and CPS, and between UCAPS and CPS (0.76). The UCAPS and CPS were responsive; all items and total scores increased after surgery. Both scales were specific (81-85%) and sensitive (82-87%). The cut-off point for rescue analgesia was >4 for UCAPS and >3 for CPS.

CONCLUSIONS

The UCAPS and CPS are valid and reliable to assess postoperative pain in Bos taurus and Bos indicus bulls.

Patient Reported Outcomes and Measures in Children with Rhabdomyosarcoma

In addition to optimising survival of children with rhabdomyosarcoma (RMS), more attention is now focused on improving their quality of life (QOL) and reducing symptoms during treatment, palliative care or into long-term survivorship. QOL and ongoing symptoms related to the disease and its treatment are outcomes that should ideally be patient-reported (patient-reported outcomes, PROs) and can be assessed using patient-reported outcome measures (PROMS). This commentary aims to encourage PRO and PROM use in RMS by informing professionals in the field of available PROMs for utilisation in paediatric RMS and provide considerations for future use in research and clinical practice. Despite the importance of using PROMs in research and practice, PROMs have been reported scarcely in paediatric RMS literature so far. Available literature suggests lower QOL of children with RMS compared to general populations and occurrence of disease-specific symptoms, but a lack of an RMS-specific PROM. Ongoing developments in the field include the development of PROMs targeted at children with RMS specifically and expansion of PROM evaluation within clinical trials.

Guidelines for Reporting Outcomes in Trial Protocols: The SPIRIT-Outcomes 2022 Extension

IMPORTANCE

Complete information in a trial protocol regarding study outcomes is crucial for obtaining regulatory approvals, ensuring standardized trial conduct, reducing research waste, and providing transparency of methods to facilitate trial replication, critical appraisal, accurate reporting and interpretation of trial results, and knowledge synthesis. However, recommendations on what outcome-specific information should be included are diverse and inconsistent. To improve reporting practices promoting transparent and reproducible outcome selection, assessment, and analysis, a need for specific and harmonized guidance as to what outcome-specific information should be addressed in clinical trial protocols exists.

OBJECTIVE

To develop harmonized, evidence- and consensus-based standards for describing outcomes in clinical trial protocols through integration with the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) 2013 statement.

EVIDENCE REVIEW

Using the Enhancing the Quality and Transparency of Health Research (EQUATOR) methodological framework, the SPIRIT-Outcomes 2022 extension of the SPIRIT 2013 statement was developed by (1) generation and evaluation of candidate outcome reporting items via consultation with experts and a scoping review of existing guidance for reporting trial outcomes (published within the 10 years prior to March 19, 2018) identified through expert solicitation, electronic database searches of MEDLINE and the Cochrane Methodology Register, gray literature searches, and reference list searches; (2) a 3-round international Delphi voting process (November 2018-February 2019) completed by 124 panelists from 22 countries to rate and identify additional items; and (3) an in-person consensus meeting (April 9-10, 2019) attended by 25 panelists to identify essential items for outcome-specific reporting to be addressed in clinical trial protocols.

FINDINGS

The scoping review and consultation with experts identified 108 recommendations relevant to outcome-specific reporting to be addressed in trial protocols, the majority (72%) of which were not included in the SPIRIT 2013 statement. All recommendations were consolidated into 56 items for Delphi voting; after the Delphi survey process, 19 items met criteria for further evaluation at the consensus meeting and possible inclusion in the SPIRIT-Outcomes 2022 extension. The discussions during and after the consensus meeting yielded 9 items that elaborate on the SPIRIT 2013 statement checklist items and are related to completely defining and justifying the choice of primary, secondary, and other outcomes (SPIRIT 2013 statement checklist item 12) prospectively in the trial protocol, defining and justifying the target difference between treatment groups for the primary outcome used in the sample size calculations (SPIRIT 2013 statement checklist item 14), describing the responsiveness of the study instruments used to assess the outcome and providing details on the outcome assessors (SPIRIT 2013 statement checklist item 18a), and describing any planned methods to account for multiplicity relating to the analyses or interpretation of the results (SPIRIT 2013 statement checklist item 20a).

CONCLUSIONS AND RELEVANCE

This SPIRIT-Outcomes 2022 extension of the SPIRIT 2013 statement provides 9 outcome-specific items that should be addressed in all trial protocols and may help increase trial utility, replicability, and transparency and may minimize the risk of selective nonreporting of trial results.

Guidelines for Reporting Outcomes in Trial Reports: The CONSORT-Outcomes 2022 Extension

IMPORTANCE

Clinicians, patients, and policy makers rely on published results from clinical trials to help make evidence-informed decisions. To critically evaluate and use trial results, readers require complete and transparent information regarding what was planned, done, and found. Specific and harmonized guidance as to what outcome-specific information should be reported in publications of clinical trials is needed to reduce deficient reporting practices that obscure issues with outcome selection, assessment, and analysis.

OBJECTIVE

To develop harmonized, evidence- and consensus-based standards for reporting outcomes in clinical trial reports through integration with the Consolidated Standards of Reporting Trials (CONSORT) 2010 statement.

EVIDENCE REVIEW

Using the Enhancing the Quality and Transparency of Health Research (EQUATOR) methodological framework, the CONSORT-Outcomes 2022 extension of the CONSORT 2010 statement was developed by (1) generation and evaluation of candidate outcome reporting items via consultation with experts and a scoping review of existing guidance for reporting trial outcomes (published within the 10 years prior to March 19, 2018) identified through expert solicitation, electronic database searches of MEDLINE and the Cochrane Methodology Register, gray literature searches, and reference list searches; (2) a 3-round international Delphi voting process (November 2018-February 2019) completed by 124 panelists from 22 countries to rate and identify additional items; and (3) an in-person consensus meeting (April 9-10, 2019) attended by 25 panelists to identify essential items for the reporting of outcomes in clinical trial reports.

FINDINGS

The scoping review and consultation with experts identified 128 recommendations relevant to reporting outcomes in trial reports, the majority (83%) of which were not included in the CONSORT 2010 statement. All recommendations were consolidated into 64 items for Delphi voting; after the Delphi survey process, 30 items met criteria for further evaluation at the consensus meeting and possible inclusion in the CONSORT-Outcomes 2022 extension. The discussions during and after the consensus meeting yielded 17 items that elaborate on the CONSORT 2010 statement checklist items and are related to completely defining and justifying the trial outcomes, including how and when they were assessed (CONSORT 2010 statement checklist item 6a), defining and justifying the target difference between treatment groups during sample size calculations (CONSORT 2010 statement checklist item 7a), describing the statistical methods used to compare groups for the primary and secondary outcomes (CONSORT 2010 statement checklist item 12a), and describing the prespecified analyses and any outcome analyses not prespecified (CONSORT 2010 statement checklist item 18).

CONCLUSIONS AND RELEVANCE

This CONSORT-Outcomes 2022 extension of the CONSORT 2010 statement provides 17 outcome-specific items that should be addressed in all published clinical trial reports and may help increase trial utility, replicability, and transparency and may minimize the risk of selective nonreporting of trial results.

Measurement properties of the WHO Disability Assessment Schedule 2.0 for evaluating functional status after inpatient surgery

BACKGROUND

Expert recommendations propose the WHO Disability Assessment Schedule (WHODAS) 2.0 as a core outcome measure in surgical studies, yet data on its long-term measurement properties remain limited. These were evaluated in a secondary analysis of the Measurement of Exercise Tolerance before Surgery (METS) prospective cohort.

METHODS

Participants were adults (40 years of age or older) who underwent inpatient non-cardiac surgery. The 12-item WHODAS and EQ-5DTM-3L questionnaires were administered preoperatively (in person) and 1 year postoperatively (by telephone). Responsiveness was characterized using standardized response means (SRMs) and correlation coefficients between change scores. Construct validity was evaluated using correlation coefficients between 1-year scores and comparisons of WHODAS scores across clinically relevant subgroups.

RESULTS

The analysis included 546 patients. There was moderate correlation between changes in WHODAS and various EQ-5DTM subscales. The strongest correlation was between changes in WHODAS and changes in the functional domains of the EQ-5D-3L-for example, mobility (Spearman's rho 0.40, 95 per cent confidence interval [c.i.] 0.32 to 0.48) and usual activities (rho 0.45, 95 per cent c.i. 0.30 to 0.52). When compared across quartiles of EQ-5D index change, median WHODAS scores followed expected patterns of change. In subgroups with expected functional status changes, the WHODAS SRMs ranged from 'small' to 'large' in the expected directions of change. At 1 year, the WHODAS demonstrated convergence with the EQ-5D-3L functional domains, and good discrimination between patients with expected differences in functional status.

CONCLUSION

The WHODAS questionnaire has construct validity and responsiveness as a measure of functional status at 1 year after major surgery.