Measuring change over time: assessing the usefulness of evaluative instruments

Minimum clinically important difference of the original and short-form Örebro musculoskeletal pain questionnaire for low back pain

BACKGROUND

The Örebro Musculoskeletal Pain Questionnaire (Örebro), although originally designed as a screening tool, has become more prevalently used as an outcome measure in the literature. To our knowledge, no study has investigated the Örebro's performance as an outcome measure. The minimum clinically important difference (MCID) is a fundamental psychometric property of outcome measures.

OBJECTIVES

This study aimed to evaluate the performance of the Örebro (original and short-form versions) as an outcome measure, including establishing its MCID.

METHODS

This was a secondary analysis of a randomised controlled trial. The study sample consisted of 300 low back pain patients, receiving physiotherapy. Patients completed the Örebro at 5 timepoints. To establish the MCID, an anchor-based method using receiver operating characteristic (ROC) curve analysis was utilised as our primary analysis method, supplemented with a distribution-based method deriving the standard error of measurement. Subpopulation analyses were carried out based on allocated treatment group and Örebro baseline score.

RESULTS

Both questionnaires were capable of detecting change over time as all area under the curves (AUCs) were >0.7. The MCID was 20.3 for the Örebro and 9.0 for the SF-Örebro according to anchor-based methods. Using distribution-based methods, the MCID for the Örebro was 23.6 and 12.1 for the SF-Örebro. The MCID was larger for individuals with a higher baseline score but appeared independent of treatment group.

CONCLUSIONS

Both questionnaires were suitable for detecting change over time. To our knowledge, this is the first study to report a MCID estimation for either questionnaire.

Identifying Independent Predictors of Achieving Clinically Significant Outcomes After Contemporary Hip Arthroscopic Surgery for Femoroacetabular Impingement Syndrome at a Minimum 10-Year Follow-up

BACKGROUND

Patients undergoing hip arthroscopic surgery for femoroacetabular impingement syndrome (FAIS) have been shown to achieve clinically significant outcomes (CSOs) at high rates. However, limited studies, to date, have identified independent predictors of achieving CSOs at a minimum 10-year follow-up, and even fewer studies have reported on patients treated with contemporary hip arthroscopic techniques, including chondrolabral preservation, surgical correction of FAIS morphology, and capsular repair.

PURPOSE

To identify independent predictors of achieving minimum 10-year CSOs after contemporary hip arthroscopic surgery for FAIS with chondrolabral preservation, surgical correction of FAIS morphology, and capsular repair.

STUDY DESIGN

Case series; Level of evidence, 4.

METHODS

Patients undergoing primary contemporary hip arthroscopic surgery for FAIS between January 2012 and November 2013 with a minimum 10-year follow-up were identified. Patient-reported outcomes (PROs) collected included scores for the Hip Outcome Score-Activities of Daily Living, Hip Outcome Score-Sports Subscale, International Hip Outcome Tool-12, modified Harris Hip Score, and visual analog scale for pain. Cohort-specific thresholds for the minimal clinically important difference (MCID), Patient Acceptable Symptom State (PASS), and substantial clinical benefit (SCB) were determined, and achievement rates were recorded. Patients achieving and not achieving each CSO for any PRO measure were compared. Stepwise multivariate logistic regression was used to identify independent predictors of achieving the MCID, PASS, and SCB for any PRO measure, with the odds ratio (OR) recorded.

RESULTS

A total of 294 patients with a minimum 10-year follow-up were included in this study. The mean age was 33.8 ± 12.3 years, and the mean body mass index was 25.0 ± 4.8 kg/m2. Most patients were female (60.2%). The reoperation-free survivorship rate was 85.0%. Achievement rates for the MCID, PASS, and SCB were 91.4%, 77.6%, and 71.6%, respectively. Independent predictors of achieving CSOs were age (OR, 0.97-0.98; P ≤ .039), sport participation (OR, 1.84-2.18; P ≤ .042), psychiatric history (OR, 0.46-0.47; P ≤ .041), and high-grade chondral defects (OR, 0.25-0.39; P ≤ .019).

CONCLUSION

Independent predictors of achieving 10-year CSOs after contemporary hip arthroscopic surgery with chondrolabral preservation, surgical correction of FAIS morphology, and capsular repair were younger age, the presence of sport participation, the absence of a psychiatric history, and the absence of chondral defects.

Minimal Clinically Important Difference in Patients with Knee Cartilage Lesions Treated with a Cell-Free Scaffold Implantation

ObjectiveThe aim of this study was to establish the minimal clinically important difference (MCID) thresholds for the International Knee Documentation Committee (IKDC) subjective and Visual Analogue Scale (VAS) pain scores in patients affected by knee chondral and osteochondral lesions treated with cell-free scaffold implantation.DesignFor the MCID definition, 186 patients who underwent an osteochondral scaffold implantation were included. Patients were evaluated through the IKDC subjective and VAS pain scores at baseline, 12 and 24 months. The MCID was calculated using a distribution-based method for both IKDC subjective and VAS pain scores at 12 and 24 months, as well as with an anchor-based method.ResultsThe MCID values were 10.1 and 1.5 for the IKDC subjective and VAS pain scores, respectively, both at 12 and 24 months of follow-up. The rate of patients who achieved the MCID was 83% at 12 months and 88% at 24 months. The anchor-based method led to higher MCID values. Factors identified to increase the probability to reach the MCID were younger age (P = 0.042), male sex (P = 0.042), and lateral femoral condyle lesions (P = 0.002), while patellar lesions were less likely to reach the MCID (P = 0.009).ConclusionsThis study defined the MCID values for the IKDC subjective and VAS pain scores after treatment with a cell-free biomimetic scaffold, with 88% of the patients achieving clinically relevant results at 2 years. Younger patients, males and lateral femoral condyle lesions were more likely to reach the MCID. However, the identified thresholds can be influenced by the method chosen, which warrants caution when interpreting study results.

Psychometric evaluation of Liking and Wanting implicit association tests for physical activity and recreational screen use

Interest in the implicit processing of activity behaviors has been growing, but the psychometric properties of its measurement are often overlooked. This study examined the reliability and validity of two implicit association tests (IATs) designed to assess implicit affective and motivational processes. In the first session, 101 college students completed a Liking-IAT, a Wanting-IAT, and a survey on their attitudes and intentions regarding physical activity and sedentary screen-based recreational activities. One week later, participants reported their engagement in these activities, and 34 of them completed the IATs again. The psychometric evaluation revealed high split-half correlation coefficients and significant correlations with behavioral attitudes and intentions for both the IATs, indicating good split-half reliability and convergent validity. The Liking IAT but not the Wanting IAT demonstrated satisfactory test-retest reliability over a one-week interval and predictive potential for weekend physical activity and screen time. Divergence in psychometric performances suggests underlying differences in corresponding implicit processes, highlighting the need for further investigation into the temporal validity, sensitivity to change, and the interplay of various implicit processes.

The minimal clinically important difference of the scleroderma clinical trials consortium damage index

Objective

The Scleroderma Clinical Trials Consortium Damage Index is an index of global damage in systemic sclerosis. The objective of this study is to determine the minimal clinically important difference of the Scleroderma Clinical Trials Consortium Damage Index.

Methods

Patients in the Canadian Scleroderma Research Group registry and the Australian Scleroderma Cohort Study who completed Scleroderma Clinical Trials Consortium Damage Index scores and the SF36v2 at baseline and the first full follow-up visit were studied. To calculate the minimal clinically important difference, an anchor question came from SF36v2: "Compared to one year ago, how would you rate your health in general?." Options were: much better, somewhat better, about the same, somewhat worse and much worse. We use the "somewhat worse" or "much worse" categories to indicate those with any worsening. We used four anchor methods: receiver operating characteristic curve, change difference, regression analysis, and average change.

Results

We studied 1672 patients. Mean disease duration was 11.4 ± 10.0 years; 62.5% had diffuse cutaneous systemic sclerosis. Baseline mean Damage Index was 5.3 ± 4.2; mean change of Damage Index over 1 year was 0.9 ± 1.8 units. The calculated minimal clinically important difference values were 1 for receiver operating characteristic method, 0.625 for change difference, 0.1879 for regression analysis, and 1.37 for average change. Omitting the regression analysis method as an outlier, the mean of the other methods was 1.

Conclusion

The most appropriate minimal clinically important difference for the Scleroderma Clinical Trials Consortium Damage Index is a change of ⩾ 1.0 units in the Scleroderma Clinical Trials Consortium Damage Index as is already recognized by patients as a significant change after 1 year. This can be applied to group means as well as to individuals where an ordinal change is required.

Longitudinal Evaluation of the HABC Monitor Among Trauma Survivors

Purpose

To examine the sensitivity to change of the Healthy Aging Brain Care Monitor (HABC-M) through a longitudinal analytical comparison with reference standards.

Patients and Methods

We used longitudinal data from 120 participants in a multicenter randomized controlled trial evaluating the effectiveness of the Trauma Medical Home (TMH). We used the following reference standards: The depression and anxiety subdomains of the Hospital Anxiety and Depression Scale (HADS), the Patient-Reported Outcomes Measurement Information System Sleep Disturbance Short Form 4a (PROMIS-SF), and the Pain, Enjoyment of Life, and General Activity Scale (PEG). We assessed sensitivity to change using three longitudinal comparative analytical methods. The correlation of the HABC-M score with reference standards' scores over time, the correlation of changes in the HABC-M score with changes in reference standards' scores, and a longitudinal analysis to compare changes in the HABC-M against reference standards' known change categories.

Results

Throughout the six-month period, the HABC-M exhibited moderate to high correlations with the HADS (r = 0.66, p<0.001 for the depression subdomain and r = 0.42, p<0.001 for the anxiety subdomain), the PROMIS-SF (r = 0.57, p<0.001), and the PEG (r = 0.47, p<0.001). The changes in HABC-M significantly correlated with changes in reference standards at various time points. HABC-M scores were significantly different across known change categories established by the four reference standards, with standardized response mean (SRM) values ranging from 1.08 to 1.44.

Conclusion

The HABC-M is capable of monitoring the recovery of older trauma survivors.

Home-Based, Remotely Supervised Transcranial Direct Current Stimulation Improves the Overall Pain Experience of Older Adults With Knee Osteoarthritis

Objective: Chronic pain in knee osteoarthritis (OA) is a multidimensional phenomenon requiring thorough assessment and appropriate treatment. We assessed the impact of home-based, remotely supervised transcranial direct current stimulation (tDCS) on the overall pain experience of older adults with knee OA by simultaneously examining its effects on multiple pain domains-pain intensity, pain interference, and pain catastrophizing-using multigroup latent transition analysis (LTA). Methods: This secondary analysis of a randomized clinical trial involved 120 participants with knee OA pain, randomly assigned in a 1:1 ratio to receive 15 daily sessions of 2-mA tDCS or sham tDCS (20 min per session) over three weeks, with real-time remote supervision. Pain intensity was measured using the Numeric Rating Scale (NRS) and the pain subscale of the Western Ontario and McMaster Universities Osteoarthritis (WOMAC) Index. Pain interference was measured using the WOMAC functional scale. Pain catastrophizing was assessed using the Pain Catastrophizing Scale (PCS). All the measures were assessed at baseline and at the end of each week (weeks 1, 2, and 3), after the participants had completed five tDCS sessions per week. Multigroup LTA enabled the simultaneous measurement of multiple pain domains and analysis of their changes as a function of intervention exposure by modeling the transition probabilities of latent classes and comparing these changes between the groups. Results: Based on the NRS, WOMAC, and PCS scores, three latent categories were identified: "high pain (all scores high)," "moderate pain (all scores moderate)," and "low pain (all scores low)." Active group participants with "moderate pain" at baseline had a 24.2% probability of transitioning to "low pain" after Week 1, whereas sham group participants remained stagnant during this interval. Notably, 37.6% of active group participants with "high pain" at Week 1 transitioned to "moderate pain," while 35.8% of those with "moderate pain" at Week 1 transitioned to "low pain" by Week 2 (after an additional five sessions). Nevertheless, no noticeable changes were observed in the sham group during this period. No pronounced intervention effects were noted by Week 3. Conclusions: Simultaneously modeling pain-related measures enriches our understanding of the efficacy of tDCS in improving the overall pain experience among older adults with knee OA. Trial Registration: ClinicalTrials.gov identifier: NCT04016272.

Modification of an outcome measure to follow symptoms of children with acute otitis media

BACKGROUND

To modify a parent-reported acute otitis media severity of symptoms scale (AOM-SOS) to ensure that it accurately reflects parental concerns.

METHODS

Using qualitative interviews with parents of children with acute otitis media (AOM) (n = 24), we generated 39 candidate items for inclusion in the new version of the scale. We determined the importance of each item by enrolling 50 other parents of children with AOM. We selected 15 items with high importance and used them to create a new version of the scale. During successive rounds of cognitive interviews, 3 items were dropped. Two additional items were dropped because they were highly correlated. We evaluated the psychometric properties of the new, 10-item version (version 6.0) in 139 children with AOM.

RESULTS

AOM-SOS scores correlated with functional status (r = -0.53), parent assessment of child's pain level (r = 0.69), and overall symptom severity (r = 0.41). The internal consistency of the scale, as measured by Cronbach's alpha, was 0.90. Responsiveness (standardized response mean = 1.82) and test-retest reliability (0.77) were excellent and good, respectively.

CONCLUSION

Data presented here support the use of the new version of the scale as a longitudinal measure of symptom burden in clinical trials of children with AOM.

IMPACT STATEMENT

The AOM-SOS scale, which now incorporates parental views, can be used to track symptom severity in future efficacy trials in young children with acute otitis media. Data is presented on the validity, reliability, and responsiveness of the AOM-SOS scale. Otitis media is the most frequent indication for antibiotic use in young children. The AOM-SOS is one of the few validated disease specific scales available for use in efficacy trials of children with acute otitis media.

Does occlusal morphology of artificial teeth improve chewing of removable dentures wearers? A systematic review and meta-analysis

PURPOSE

This systematic review aimed to verify whether anatomic, semi-anatomic, or nonanatomic occlusal morphology of artificial teeth improves the masticatory function of complete or removable partial denture wearers.

MATERIALS AND METHODS

According to the PICO strategy, six databases and the grey literature were searched to identify randomized (RCT) and non-randomized clinical trials (N-RCT) comparing masticatory function, in terms of masticatory performance and efficiency, and muscle activity as primary outcomes; and patient-reported results (O) in individuals using removable dentures (P) with different occlusal morphologies of artificial teeth (I/C). Masticatory ability, satisfaction with the prosthetic treatment, and oral health-related quality of life (OHRQoL) were evaluated as secondary outcomes. Risk of bias was assessed using the Cochrane risk-of-bias tool for randomized trials (RoB 2.0) for RCT and Risk of Bias for non-randomized studies with intervention (ROBINS-I) for N-RCT studies. Meta-analyses were performed to compare primary outcomes and masticatory ability between the occlusal morphologies of artificial teeth of complete or removable partial dentures (α = 0.05). Certainty of the evidence was verified using the GRADE approach.

RESULTS

Eleven studies (seven RCTs and four N-RCTs) were included. The risk of bias was considered low for two studies, some concerns for five, and high for the last four studies. Meta-analyses showed that removable partial dentures with anatomic artificial teeth improved masticatory efficiency for carrot chewing (MD 6.31; 95% CI [3.39, 9.22], I2 = 0%). However, masseter and temporal muscle activities increased when removable partial dentures with nonanatomic teeth were used (MD -756.97; 95% CI [-892.25, -621.68], I2 = 100%). Masticatory ability was not influenced by occlusal morphology during chewing of all foods in complete denture users: Carrot (MD -0.88, 95% CI [-8.98, 7.23], I2 = 57%); sausage (MD -8.86, 95% CI [-23.05, 5.33], I2 = 71%); apple (MD -5.78, 95% CI [-28.82, 17.26], I2 = 87%); and cheese (MD -4.16, 95% CI [-15.14, 6.82], I2 = 62%). The certainty of evidence for all evaluated outcomes was very low, mainly due to very serious problems found in the parameters of inconsistency, indirectness, and imprecision.

CONCLUSIONS

Despite the very low certainty of evidence, the occlusal morphology of artificial teeth influences masticatory function. Anatomic teeth improved the masticatory efficiency and muscle activity of removable partial denture wearers. Nonanatomic teeth increased temporal and masseter muscle activity, which negatively affected chewing in removable partial denture users. However, patients using complete dentures with anatomic and semi-anatomic teeth presented similar masticatory ability.

Validation of visual analog scales of mood and anxiety at the workplace

The Hospital Anxiety and Depression Scale (HADS) is commonly used to detect depressive or anxious states, but its 14-item questionnaire is time-consuming. Visual analog scales (VAS) are easy to use and quick to implement. Although the VAS has been validated to assess pain and occupational stress, VAS scores for anxiety and mood have never been evaluated in the workplace. We aimed to validate the use of visual analog scales (VAS) for anxiety and mood compared to HADS in workers. A HADS self-reported questionnaire associated with VAS assessing perceived anxiety and mood on a horizontal line of 100 mm was administered to 182 workers, with a second test (retest) proposed one week later. Sociodemographic, characteristics of work, sleep, well-being, and stress were also assessed. VAS anxiety and mood correlated with the HADS sub-scores (0.70 and 0.65, respectively). The test-retest reliability was good. Optimal VAS cut-offs were ≥ 60/100 for anxiety and ≤ 60/100 for mood, to define at-risk patients. The VAS is quick to perform, easy to use, and reliable for screening depression and anxiety in occupational medicine. We recommend validated questionnaires for at-risk patients.

TRIAL REGISTRATION

CLINICALTRIALS

gov: NCT02596737. Available at: https://www.

CLINICALTRIALS

gov/ct2/show/NCT02596737.

Psychometric properties of the Iranian version of the polycystic ovary syndrome quality of life questionnaire for married and unmarried women with PCOS: PCOSQoL-47 and PCOSQoL-42

INTRODUCTION

The incidence of PCOS is notably elevated in Iran, making it crucial to examine the quality of life among these individuals. This study aimed to thoroughly evaluate the psychometric properties of the Iranian adaptations of the PCOSQoL-47 and PCOSQoL-42 questionnaires. The application of these tools is significant as they could enhance further research in in communities with similar social norms concerning marriage and sexuality.

METHODS

This study employed a cross-sectional design. Following the linguistic validation of the Iranian adaptation of the PCOSQoL-47 and PCOSQoL-42, a panel of experts reviewed the items through an evaluation of the content validity index (CVI) and content validity ratio (CVR). Subsequently, a semi-structured interview was carried out to evaluate face validity. Consequently, discriminant validity was assessed using the known groups comparison. Convergent validity was evaluated by assessing the correlation between similar content on the PCOSQoL-47 and PCOSQoL-42, SF-12 and body image questionnaire. Responsiveness was assessed by comparing two scales scoring in baseline and eight-week follow-up data of prescription contraceptive Daine-35. In addition, reliability analyses including internal consistency and test-retest analysis were carried out.

RESULTS

The CVR in this study for the total scale was 0.98 for two scales, indicating a satisfactory result. The CVI for the scale was found to be 0.98 and 0.99 for PCOSQoL-42 and PCOSQoL-47, respectively suggesting that it had a good content validity. Known groups comparison revealed that the two scales effectively distinguished between sub-groups of women with varying symptoms specific to PCOS, thereby supporting their discriminant validity. Additionally, convergent validity was evaluated and, as anticipated, a strong positive correlation was observed between corresponding subscales of the two instruments. The paired t-test showed significant changes in PCOSQoL-47 and PCOSQoL-42 scores (p < 0.001) indicating as a responsive outcome measure to detect significant changes over time before and after treatment. Additional analyses indicated satisfactory results of PCOSQoL-42 for internal consistency (Cronbach's alpha ranging from 0.72 to 0.78) and intraclass correlation coefficients (ranging 0.67 to 0.92; P < 0.05). regarding PCOSQoL-47, Cronbach's alpha ranging from 0.80 to 0.82 and intraclass correlation coefficients (ranging 0.61 to 0.73; P < 0.05).

CONCLUSION

The PCOSQoL-47 and PCOSQoL-42 have undergone thorough testing in Iran and may be utilized as outcome measures in forthcoming studies within this demographic.

How to interpret patient-reported outcomes? - Stratified adjusted minimal important changes for the EQ-5D-3L in hip and knee replacement patients

BACKGROUND

As one of the main goals of hip and knee replacements is to improve patients' health-related quality of life, a meaningful evaluation can be achieved by calculating minimal important changes (MICs) for improvements in patient-reported outcome measures (PROMs). This study aims at providing MICs adjusted for patient characteristics for EQ-5D-3L index score improvements after hip and knee replacements. It adds to existing literature by relying on a large national sample and precise clustering algorithms, and by employing a state-of-the-art methodology for the calculation of improved adjusted MICs.

METHODOLOGY

A retrospective observational study was conducted using the publicly available National Health Service (NHS) PROMs dataset for primary hip and knee replacements. We used information on 252,331 hip replacements and 279,668 knee replacements from all NHS-funded providers in England between 2013 and 2020. Clusters of patients were created based on pre-operative EQ-VAS, depression status, and sex. Unstratified and stratified estimates for meaningful EQ-5D-3L improvements were obtained through anchor-based predictive MICs corrected for the proportion of improved patients and the reliability of transition ratings.

RESULTS

Stratifying patients showed that MICs varied across subgroups based on pre-operative EQ-VAS, depression status, and sex. MICs were larger for patients with worse pre-operative EQ-VAS scores, while patients with better pre-operative scores required smaller MICs to achieve a meaningful change. We show how after stratification the percentage of patients achieving their stratified MIC was better in line with the actual share of improved patients. Larger MICs were found for patients with depression and for female patients. MICs calculated for knee replacements were consistently lower than those for hip replacements.

CONCLUSIONS

Our findings show the importance of adjusting MICs for patients' characteristics and should be considered for quality-related choices and policy initiatives.

Guidelines for the development and validation of patient-reported outcome measures: a scoping review

OBJECTIVE

The objectives of this scoping review were to provide an overview of existing guidelines for the development and validation of patient-reported outcome measures (PROMs), review them for comprehensiveness and clarity and provide recommendations for their use based on the goals of the instrument developers.

DESIGN

Scoping review.

METHODS

A literature search was performed in PubMed, Scopus, PsycInfo and Google Scholar up to 2 June 2023 to identify guidelines for the development and validation of PROMs. Screening of records and reports as well as data extraction were performed by two reviewers. To assess the comprehensiveness of the included guidelines, a mapping synthesis was performed and steps to develop and validate a measurement instrument outlined in the included guidelines were mapped to an a priori framework including 20 steps, which was based on the guideline by de Vet et al.

RESULTS

A total of 40 guidelines were included. Statistical advice (at least partially) was provided in 98% of the guidelines (39/40) and 88% (35/40) of the guidelines included examples for steps required to develop and validate PROMs. However, 78% (31/40) of the guidelines were not comprehensive and two essential steps in PROM development ('consideration and elaboration of the measurement model' and 'responsiveness') were not included in 80% and 72% of the guidelines, respectively. Three guidelines included all 20 steps and six included almost all steps (≥90% of steps) for developing and validating a PROM.

DISCUSSION

Most guidelines on PROM development and validation do not appear to be comprehensive, and some crucial steps are missing in most guidelines. Nevertheless, for some purposes of PROMs, many guidelines provide helpful advice and support.

CONCLUSION

At least 15 guidelines may be recommended, including three comprehensive guidelines that can be recommended for the development and validation of PROMs for most purposes (eg, to discriminate between subjects with a particular condition and subjects without that condition, to evaluate the effects of treatments (between a pre and post time-points) or to evaluate a status quo).

A comprehensive review of patient-reported outcomes in metabolic dysfunction-associated steatotic liver disease

The global prevalence of obesity and type 2 diabetes has increased, contributing to an increased worldwide prevalence of metabolic dysfunction-associated steatotic liver disease (MASLD). Currently, one in three adults is affected by MASLD and/or its progressive form, metabolic dysfunction-associated steatohepatitis (MASH), making this liver disease a significant public health challenge. Along with MASH-related cirrhosis, these conditions are poised to become the leading causes of chronic liver disease and liver transplants in the near future. Given the growing burden of MASLD and MASH, it is crucial to understand their impact from the patients’ perspective. One way to do this is by assessing patient-reported outcomes (PROs), including health-related quality of life (HRQL). HRQL can be assessed using generic instruments like the short form 36 version (SF-36) and the European quality of life-5 dimensions questionnaire (EQ-5D), or disease-specific tools such as the chronic liver disease questionnaire for nonalcoholic steatohepatitis (CLDQ-NASH). Given the limitations of each instrument, the best approach generally involves using both generic and disease-specific instruments. Evidence indicates that HRQL scores are significantly lower in individuals with MASLD, especially in areas assessing physical activity and the ability to perform daily living tasks. Fatigue and impaired work productivity are also important PROs for those with MASLD/MASH. These decrements in PROs worsen with disease progression but appear to improve with disease regression, including improvements linked to treatment. In this context, measuring PROs enhances the assessment of other patient-centric outcomes and provides insights for the healthcare community to develop interventions that could improve both clinical and humanistic outcomes for individuals living with MASLD/MASH.

Validity evidence for the clinical communication skills assessment tool (CCSAT) from 9 years of implementation in a high stakes medical student OSCE

OBJECTIVES

Communication and other clinical skills are routinely assessed in medical schools using Objective Structured Clinical Examinations (OSCEs) so routinely that it can be difficult to monitor and maintain validity. We report on the accumulation of validity evidence for the Clinical Communication Skills Assessment Tool (CCSAT) based on its use with 9 cohorts of medical students in a high stakes OSCE.

METHODS

We describe the implementation of the CCSAT including information on the underlying model, the tool's items, domains, scales and scoring, and its role in curriculum. Internal structure is explored through item, internal consistency, and confirmatory factor analyses. Evidence for CCSAT validity is synthesized within prevailing frameworks (Messick12 and Kane13) based on continuous quality improvement and use of the CCSAT for feedback, remediation, curricular design, and research.

RESULTS

Implementation of the CCSAT over time has facilitated our communication skills curriculum and training. Thoughtful case development and investment in standardized patient training has contributed to data quality. Item analysis supports our behaviorally anchored scale (not done, partly and well done) and the skills domains suggested by an a priori evidence-based clinical communication model were confirmed via analysis of actual student data. Evidence synthesized across the frameworks suggests consistent validity of the CCSAT for generalization inferences (that it captures the construct), responsiveness (sensitivity to change/difference), content validity/internal structure, relationships to other variables, and consequences/implications. More evidence is needed to strengthen validity of CCSAT scores for understanding extrapolation inferences and real-world implications.

CONCLUSIONS AND PRACTICE IMPLICATIONS

This pragmatic approach to evaluating validity within a program of assessment serves as a model for medical schools seeking to continuously monitor the quality of clinical skill assessments, a need made particularly relevant since the US NBME no longer requires the Step 2 Clinical Skills exam, leaving individual schools with the responsibility for ensuring graduates have acquired the requisite core clinical skills. We document strong evidence for CCSAT validity over time and across cohorts as well as areas for improvement and further examination.

Patient-Reported Outcome Measure Development and Validation: A Primer for Clinicians

A comprehensive definition of health includes the assessment of patient experiences of a disease and its treatment. These patient experiences are best captured by standardized patient-reported outcome (PRO) instruments. A PRO is reported directly by the patient (or caregiver) and provides the patient's perspective into how a disease and its treatment impact their lives. PRO instruments are typically standardized, validated questionnaires with items that are scaled and can be combined to represent an underlying health-related construct such as physical, social, and role functioning, psychological well-being, symptoms, pain, and quality of life. Over the past few decades, PROs have become increasingly used in clinical trials as endpoints to better understand treatment benefits from the patient's perspective and in clinical practice to identify unmet needs of patients, health risk surveillance, and monitor outcomes of care. In this paper, we describe the process for developing standardized PRO instruments, from conceptual model development through instrument validation.

Feasibility and acceptability of the HOLObalance telerehabilitation system compared with standard care for older adults at risk of falls: the HOLOBalance assessor blinded pilot randomised controlled study

BACKGROUND

Falls have high socioeconomic costs. Information and communication technologies may support provision and monitoring of multisensory (MSR) physiotherapy programmes. The HOLOBalance platform used augmented reality holograms to provide patient-centred, individualised MSR.

OBJECTIVES

To determine the platform's safety, acceptability and feasibility, investigate functional gait and dynamic balance benefits and provide data for a definitive trial.

DESIGN AND SETTING

Single-blinded pilot randomised controlled feasibility study. Interventions were conducted at clinical sites or participants' homes in three European countries.

PARTICIPANTS

Community-dwelling older adults (median age 73 years; 64.2% female) at risk of falls were enrolled (May 2020-August 2021).

METHODS

Participants were randomised to an 8-week clinic or home-based telerehabilitation MSR or OTAGO (control group) programme. Compliance, satisfaction, and adverse events determined feasibility. Clinical outcomes, assessed (blinded) within one-week prior to and post-intervention, included functional gait assessment (FGA), Mini BESTest and cognitive function.

RESULTS

Randomisation to completion rate was 76.15% with 109 participants recruited (n = 289 screened). Drop-out rate was similar between groups. Adverse events were reported (n = 3) in the control group. Sixty-nine percent would recommend the HOLOBalance intervention. Findings were similar for the home and clinic-based arms of each intervention; data was combined for analysis. FGA (95%CI [1.63, 4.19]) and Mini-BESTest (95%CI [1.46, 3.93]) showed greater improvement in the HOLOBalance group with a clinically meaningful change of 4/30 noted for the FGA.

CONCLUSIONS

HOLObalance was feasible to implement and acceptable to older adults at risk of falls, with FGA and Mini-BEST improvements exceeding those for the OTAGO programme. A definitive trial is warranted.

The impact on obesity-related quality of life and eating satisfaction in the early period after laparoscopic sleeve gastrectomy

INTRODUCTION

Obesity impairs patients' quality of life (QoL). Laparoscopic sleeve gastrectomy (LSG) is a common procedure for patients with severe obesity; however, studies reporting changes in obesity-related QoL are limited. The aim of this study was to assess changes in obesity-related QoL and food tolerance in the early postoperative period.

METHODS

We included 20 consecutive patients who underwent LSG between May 2021 and July 2023. We evaluated changes in obesity-related QoL 6 months after surgery using an obesity and weight loss QoL questionnaire (OWLQOL) and a weight related symptom measure (WRSM). Additionally, we assessed eating satisfaction and food tolerance after surgery.

RESULTS

The percentages of total weight loss and excess weight loss were 28.5% and 79.1%, respectively. OWLQOL scores and WRSM changed from 36.5 to 73.0 points and from 44.0 to 15.0 points (p = .007, .007), respectively. The food tolerance score decreased from 25 to 21.2 points (p < .001), while eating satisfaction showed no significant change (p = .25).

CONCLUSION

Obesity-related QoL is enhanced even in the early postoperative period, without sacrificing eating satisfaction. The findings of this study may provide valuable insights for patients when considering LSG.

Establishing minimal clinically important differences for the quality of life scale QLICD-SLE for patients with systemic lupus erythematosus based on ROC curve

The minimal clinically important difference (MCID) is an important concept with big appeal in a field struggling to interpret quality of life (QOL) and other patient-reported outcomes (PRO), is also a bridge between statistics and clinical medicine. This study uses the ROC curve to formulate the MCID value of the Quality of Life Instruments for Chronic Diseases of Systemic lupus erythematosus (QLICD-SLE V2.0) scale. Using the representative item "In general, would you say your health is" of the MOS item short form health survey(SF-36) as an anchor, the questionnaire of QLICD-SLE V2.0 and the anchor item were used to investigate the patients on the first day of hospitalization, and the day before the patient was discharged. 279 patients with lupus erythematosus were participated in this longitudinal follow-up study. The ROC curve was constructed by using the classification based on the anchor item as the gold standard and the difference score of the scale as the test variable. The cut-off point corresponding to the maximum value of the Youden index in the ROC curve is taken as the minimum clinical importance difference (MCID) value of the QLICD-SLE (V2.0) scale. The Results showed that the MCID of physical domain, psychological domain, social domain, general module, specific module and QLICD-SLE (V2.0) total scale are 8.3, 2.3, 2.5, 2.7, 9.2 and 3.2, respectively. Area under the ROC curve of QLICD-SLE (V2.0) is 0.898, P (Area = 0.5) < 0.001, the sensitivity is 100%, the specificity is 66.9%. It concluded that if the total scores after treatments changes at least 3.2 points positively, the treatment intervention can be considered as clinically significant. It is more convincing to use the corresponding cut-off point as the MCID for ROC curve method can visualize the sensitivity and specificity.

Pain-free bite force in a healthy population: Within-session test-retest reliability in different sitting positions

BACKGROUND

Pain-free bite force (PFBF) is a promising measure to evaluate bite function in temporomandibular disorders (TMDs), yet the reliability of the measure is unknown.

OBJECTIVES

Establish the (1) within-session test-retest reliability of PFBF in a healthy population for a single and mean of three trials in supported and unsupported sitting; (2) standard error of measurement (SEM) and minimal detectable change (MDC).

METHODS

Thirty healthy participants (n = 15 female, mean [SD] age = 34.4 [11.0] years) completed two sessions (30-60 min apart) comprising three PFBF trials on each side, in both supported and unsupported sitting, to provide data for 60 (30 participants × two sides) test-retest assessments. Test-retest reliability for the first trial and mean of three trials in each position were determined using intraclass correlation coefficients (ICCs), before calculating the corresponding SEM and MDC for males (M) and females (F) respectively.

RESULTS

Within-session reliability was considered excellent for a single trial in supported sitting (ICC = 0.85; SEM M/F = 99/84 N; MDC M/F = 275/232 N) and unsupported sitting (ICC = 0.91; SEM M/F = 72/59 N, MDC M/F = 200/163 N), and for a mean of three trials in supported sitting (ICC = 0.89; SEM M/F = 66/79 N, MDC M/F = 182/220 N) and unsupported sitting (ICC = 0.92; SEM M/F = 64/59 N, MDC M/F = 177/164 N).

CONCLUSION

Single and a mean of three trials in supported and unsupported sitting appear reliable methods to measure PFBF in a healthy population. Testing PFBF using a mean of three trials in unsupported sitting appears superior over other methods though due to higher test-retest reliability, and lower SEM and MDC. Future studies should examine the reliability of PFBF in TMD populations.

A protocol for the formative evaluation of the implementation of patient-reported outcome measures in child and adolescent mental health services as part of a learning health system

BACKGROUND

Mental health conditions affect one in seven young people and research suggests that current mental health services are not meeting the needs of most children and youth. Learning health systems are an approach to enhancing services through rapid, routinized cycles of continuous learning and improvement. Patient-reported outcome measures provide a key data source for learning health systems. They have also been shown to improve outcomes for patients when integrated into routine clinical care. However, implementing these measures into health systems is a challenging process. This paper describes a protocol for a formative evaluation of the implementation of patient-reported measures in a newly operational child and adolescent mental health centre in Calgary, Canada. The purpose is to optimize the collection and use of patient-reported outcome measures. Our specific objectives are to assess the implementation progress, identify barriers and facilitators to implementation, and explore patient, caregivers and clinician experiences of using these measures in routine clinical care.

METHODS

This study is a mixed-methods, formative evaluation using the Consolidated Framework for Implementation Research. Participants include patients and caregivers who have used the centre's services, as well as leadership, clinical and support staff at the centre. Focus groups and semi-structured interviews will be conducted to assess barriers and facilitators to the implementation and sustainability of the use of patient-reported outcome measures, as well as individuals' experiences with using these measures within clinical care. The data generated by the patient-reported measures over the first five months of the centre's operation will be analyzed to understand implementation progress, as well as validity of the chosen measures for the centres' population.

DISCUSSION

The findings of this evaluation will help to identify and address the factors that are affecting the successful implementation of patient-reported measures at the centre. They will inform the co-design of strategies to improve implementation with key stakeholders, which include patients, clinical staff, and leadership at the centre. To our knowledge, this is the first study of the implementation of patient-reported outcome measures in child and adolescent mental health services and our findings can be used to enhance future implementation efforts in similar settings.

Minimal important difference of the 6-minute walk test after allogenic hematopoietic stem cell transplantation

PURPOSE

The 6-min walk test (6MWT) of allogenic hematopoietic stem cell transplantation (allo-HSCT) recipients has been gaining attention; however, minimal differences have not been reported. This study aimed to determine the minimal important difference (MID) in the 6MWT among hospitalized patients with allo-HSCT.

MATERIALS AND METHODS

The MID of the 6MWT was calculated using three different methodologies based on an anchor-based method; basic anchor-based methods, linear regression analysis, and receiver operating characteristic (ROC) curve analysis. The decrease in the score of Question 2 of the European Organization for Research and Treatment of Cancer Quality of life questionnaire core-30 was included as an anchor question for calculating the MID. Both actual and percentage changes in 6MWT values from baseline and at discharge were used in the MID calculations. In the actual and percentage change of the 6MWT, the one with the larger the area under the curve in the ROC curve was recommended as the MID.

RESULTS

Among the three methods using actual values, the largest MID of the 6MWT was -37.5 m (sensitivity: 54%, specificity: 88%).

CONCLUSION

More careful follow-up after discharge is necessary for allo-HSCT patients who show a reduction of 37.5 m or more in the acute illness phase.

Internal Responsiveness of EQ-5D-5L and EORTC QLQ-C30 in Dutch Breast Cancer Patients during the First Year Post-Surgery: A Longitudinal Cohort Study

The EuroQoL 5-Dimension 5-Level questionnaire (EQ-5D-5L) and the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire Core-30 (EORTC QLQ-C30) are commonly used Patient-Reported Outcome Measures (PROMs) for breast cancer. This study assesses and compares the internal responsiveness of the EQ-5D-5L and EORTC QLQ-C30 in Dutch breast cancer patients during the first year post-surgery. Women diagnosed with breast cancer who completed the EQ-5D-5L and EORTC QLQ-C30 pre-operatively (T0), 6 months (T6), and 12 months post-surgery (T12) were included. Mean differences of the EQ-5D-5L and EORTC QLQ-C30 between baseline and 6 months (delta 1) and between baseline and 12 months post-surgery (delta 2) were calculated and compared against the respective minimal clinically important differences (MCIDs) of 0.08 and 5. Internal responsiveness was assessed using effect sizes (ES) and standardized response means (SRM) for both deltas. In total, 333 breast cancer patients were included. Delta 1 and delta 2 for the EQ-5D-5L index and most scales of the EORTC QLQ-C30 were below the MCID. The internal responsiveness for both PROMs was small (ES and SRM < 0.5), with greater internal responsiveness for delta 1 compared to delta 2. The EQ-5D-5L index showed greater internal responsiveness than the EORTC QLQ-C30 Global Quality of Life scale and summary score. These findings are valuable for the interpretation of both PROMs in Dutch breast cancer research and clinical care.

A systematic review of the psychometric properties of Quebec user evaluation of satisfaction with assistive technology (QUEST)

PURPOSE

The aim of this systematic review was to evaluate the psychometric properties of the Quebec User Evaluation of Satisfaction with Assistive Technology (QUEST).

MATERIALS AND METHODS

Searches were conducted in August 2021 on four electronic databases: MEDLINE, CINAHL, Scopus, and Web of Science. Eligible papers included cross-sectional validation studies evaluating the psychometric properties of all QUEST versions. Cronbach's alpha, intraclass correlation coefficient, and comparison tools were reported. Study quality and risk of bias were assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist.

RESULTS

Nineteen studies were included in this systematic review. Results showed that the QUEST and QUEST 2.0 were available in 10 languages, and most validation studies analysed this tool in patients using mobility devices in various clinical conditions. One article analysed the child version (QUEST 2.1) in English. The most analysed psychometric property was Cronbach's alpha for internal consistency in 14 out of 19 studies, with values ranging between 0.74 and 0.79. Overall, 17 out of 19 studies were of adequate quality, though responsiveness was never studied.

CONCLUSION

Our systematic review showed that the QUEST and its subsequent versions are reliable and valid measurement instruments to evaluate satisfaction in patients with different disabilities using various assistive technologies. This study provides useful information on the instrument's psychometric properties in different populations and cultures.

The oral and systemic health impact profile for periodontal disease (OSHIP-Perio)-Part 1: development and validation

OBJECTIVES

This study aimed to develop and validate the Oral and Systemic Health Impact Profile for Periodontal Disease (OSHIP-Perio), a disease-specific instrument for assessing the impact of periodontal disease on both general and oral health-related quality of life.

METHODS

A pool of 58 items, developed from the Oral Health Impact Profile (OHIP-49) and data generated through semi-structured patient interviews, was tested on 80 case subjects with periodontal disease and 80 control subjects. The dimensionality of the preliminary measure was evaluated using exploratory factor analysis (EFA). Rasch analysis was then performed on the primary dimension using the Winsteps software (Version 5.1.4.0) to render the final items for the OSHIP-Perio. The reliability and validity of the final OSHIP-Perio were subsequently determined.

RESULTS

Using an EFA factor loading >0.50, the primary dimension comprised 18 items. Using Rasch analysis, four items were subsequently excluded. The final OSHIP-Perio with 14 items showed excellent test-retest reliability (overall intraclass correlation coefficient index = 0.99) and internal consistency (overall Cronbach's alpha coefficient = 0.96). It also exhibited good discriminant validity when case and control groups were compared (p < 0.001). It showed very strong correlations (rho coefficients >0.90) with the OHIP-5, OHIP-14 and OHIP-49, exhibiting good concurrent validity. It demonstrated a moderate correlation (rho coefficient = 0.60) with the global health rating, exhibiting a moderate convergent validity.

CONCLUSIONS

The 14-item OSHIP-Perio exhibited good psychometric properties comparable to the OHIP-5, OHIP-14 and OHIP-49 for evaluating the impact of periodontal disease on quality of life.

Influence of malocclusion on OHRQoL in adolescents in initial orthodontic treatment phase

OBJECTIVES

Besides correcting malocclusions, another main objective of orthodontic treatment is to improve patients' oral health-related quality of life (OHRQoL). This study aimed to assess changes in OHRQoL of children within the first six months of orthodontic therapy with fixed orthodontic appliances.

METHODS

85 patients aged 11 to 14 years requiring fixed orthodontic appliance therapy were included. The children completed the German version of the Child Perceptions Questionnaire (CPQ-G-11-14) before (T0), 1 month (T1) and 6 months (T2) after the start of orthodontic treatment. The type of malocclusion was categorized according to the Index of Orthodontic Treatment Need (IOTN).

RESULTS

The initial type of malocclusion affected the children's OHRQoL, whereas gender and age did not. The IOTN dental health component (DHC) had a significant impact on the CPQ score (median CPQ of 15.00 for the group DHC 4 vs. 22.50 for DHC 5, p = 0.032). The onset of orthodontic treatment initially affected the CPQ domains "Oral symptoms" and "Functional limitations, with a change versus baseline of 2.00 (p = 0.001), but improved again after 6 months. Regression analysis demonstrated that children with an IOTN DHC 5 malocclusion experienced a greater impact on their ORHQoL, as indicated by a CPQ score 7.35 points higher than that of children with an IOTN DHC 4 malocclusion (p = 0.015).

CONCLUSIONS

At the beginning of orthodontic treatment, the OHRQoL slightly worsens, probably due to the discomfort and appearance of the appliances. However, 6 months after the start of orthodontic treatment, OHRQoL improved again in patients with severe malocclusion (IOTN 4 and 5), and approached baseline values.

CLINICAL RELEVANCE

The results help the clinician to better understand specific aspects of oral health that may be affected by different malocclusions, thereby improving the child's satisfaction and overall quality of life.

30 years with the Knee injury and Osteoarthritis Outcome Score (KOOS)

This narrative review describes the development and use of patient-reported outcomes over 30 years, focusing on the Knee injury and Osteoarthritis Outcome Score (KOOS). KOOS is a five-subscale patient-reported instrument intended for use from the time of knee injury to the development of osteoarthritis. Numerous studies have confirmed that the psychometric properties of the KOOS and its short-form KOOS-12 are acceptable. More recent research has focused on the use and interpretation of KOOS scores in clinical trials using thresholds, such as minimal important differences, patient-acceptable symptom states, and treatment failure. As an indication of KOOS's popularity, the total 3854 PubMed results for KOOS have increased exponentially since the first KOOS paper was published 25 years ago and now seem to have plateaued at around 650 annually. The selected articles are not based on a systematic search, but on the author's own publications, reading, and literature search that grew organically from that.

Sensitivity to change and responsiveness of provocative load tests among athletes with patellar tendinopathy

BACKGROUND

Pain provocation tests are recommended for assessing pain severity and as an outcome measure for individuals with patellar tendinopathy.

OBJECTIVE

To evaluate floor and ceiling effects, sensitivity to change, and responsiveness cut-offs of two provocative load tests among athletes with patellar tendinopathy.

METHODS

Athletes (N = 41) performed six repetitions for the single leg decline squat (SLDS) and resisted knee extension (KE) at baseline and 12 weeks. Participants rated their pain during each test on a visual analog scale (VAS). Sensitivity to change was assessed by calculating effect size (ES) and the standardized response mean (SRM). The responsiveness cut-offs were assessed using a combination of anchor and distribution- based methods to determine the minimal clinically important difference (MCID) for each test.

RESULTS

A floor or ceiling effect was observed in only a small number of participants for both tests except for KE, for which approximately one third of participants had a floor effect at week 12. There was higher sensitivity to change for SLDS (ES: 1.93/SRM: 1.43) compared with KE (ES:0.96/SRM: 1.09). The MCID corresponded to a decrease of 1.6 points for SLDS and 1.0 for KE, while the distribution-based method estimated 1.2 points for SLDS and 1.1 for KE.

CONCLUSION

This study found moderate to high sensitivity to change and established MCID values for the SLDS and KE test in athletes with patellar tendinopathy before and after rehabilitation. Both tests may be useful as pain on loading outcomes as athletes progress with their rehabilitation, but the KE test results in higher floor effects and has lower sensitivity to change.

Minimal clinically important difference (MCID), substantial clinical benefit (SCB), and patient-acceptable symptom state (PASS) in patients who have undergone total knee arthroplasty: a systematic review

BACKGROUND

The present systematic review investigated the minimal clinically important difference (MCID), substantial clinical benefit (SCB), and patient-acceptable symptom state (PASS) of several frequent and established PROMs used to assess patients who have undergone TKA. This study was conducted according to the 2020 PRISMA statement.

METHODS

In September 2023, PubMed, Web of Science, and Embase were accessed with no time constraint All clinical studies investigating tools to assess the clinical relevance of PROMs used to evaluate patients having received TKA were accessed. Only studies which evaluated the MCID, PASS, or SCB were eligible. The PROMs of interest were the Forgotten Joint Score-12 (FJS-12), the Oxford Knee Score (OKS), the Knee Injury and Osteoarthritis Outcome Score (KOOS) and its related subscales activity of daily living (ADL), pain, quality of life (QoL), sports and recreational activities, and symptoms, the Western Ontario and McMaster Universities Osteoarthritis (WOMAC) score, the Knee Society Score (KSS) and related function score, and the Short Form-12 (SF-12) and Short Form-36 (SF-36).

RESULTS

Data from 29,737 patients were collected. The overall risk of bias was low to moderate. The great variability of thresholds for MCID, SCB and PASS between questionnaires but also between investigated aspects was noted, whereby MCIDs for the SF-36 appear lower than for knee-specific questionnaires.

CONCLUSION

Despite its critical role from a patient's perspective, the dimension of SCB is still neglected in the literature. Moreover, thresholds for the different concepts need to be condition-specific. We encourage authors to specifically report such data in future studies and to adhere to previously reported definitions to allow future comparison. Level of evidence Level IV, systematic review and meta-analysis.

Quantifying Interrater Agreement and Reliability Between Thoracic Pathologists: Paradoxical Behavior of Cohen's Kappa in the Presence of a High Prevalence of the Histopathologic Feature in Lung Cancer

Introduction

Cohen's kappa is often used to quantify the agreement between two pathologists. Nevertheless, a high prevalence of the feature of interest can lead to seemingly paradoxical results, such as low Cohen's kappa values despite high "observed agreement." Here, we investigate Cohen's kappa using data from histologic subtyping assessment of lung adenocarcinomas and introduce alternative measures that can overcome this "kappa paradox."

Methods

A total of 50 frozen sections from stage I lung adenocarcinomas less than or equal to 3 cm in size were independently reviewed by two pathologists to determine the absence or presence of five histologic patterns (lepidic, papillary, acinar, micropapillary, solid). For each pattern, observed agreement (proportion of cases with concordant "absent" or "present" ratings) and Cohen's kappa were calculated, along with Gwet's AC1.

Results

The prevalence of any amount of the histologic patterns ranged from 42% (solid) to 97% (acinar). On the basis of Cohen's kappa, there was substantial agreement for four of the five patterns (lepidic, 0.65; papillary, 0.67; micropapillary, 0.64; solid, 0.61). Acinar had the lowest Cohen's kappa (0.43, moderate agreement), despite having the highest observed agreement (88%). In contrast, Gwet's AC1 values were close to or higher than Cohen's kappa across patterns (lepidic, 0.64; papillary, 0.69; micropapillary, 0.71; solid, 0.73; acinar, 0.85). The proportion of positive versus negative agreement was 93% versus 50% for acinar.

Conclusions

Given the dependence of Cohen's kappa on feature prevalence, interrater agreement studies should include complementary indices such as Gwet's AC1 and proportions of specific agreement, especially in settings with a high prevalence of the feature of interest.

Pain Scales: What Are They and What Do They Mean

PURPOSE OF REVIEW

It is essential to have validated and reliable pain measurement tools that cover a wide range of areas and are tailored to individual patients to ensure effective pain management. The main objective of this review is to provide comprehensive information on commonly used pain scales and questionnaires, including their usefulness, intended purpose, applicability to different patient populations, and associated advantages and disadvantages.

RECENT FINDINGS

Acute pain questionnaires typically focus on measuring the severity of pain and the extent of relief achieved through interventions. Chronic pain questionnaires evaluate additional aspects such as pain-related functional limitations, psychological distress, and psychological well-being. The selection of an appropriate pain scale depends on the specific assessment objectives. Additionally, each pain scale has its strengths and limitations. Understanding the differences among these pain scales is essential for selecting the most appropriate tool tailored to individual patient needs in different settings.

CONCLUSION

Medical professionals encounter challenges in accurately assessing pain. Physicians must be familiar with the different pain scales and their applicability to specific patient population.

Minimal important change and difference in health outcome: An overview of approaches, concepts, and methods

OBJECTIVE

To provide an overview of approaches, concepts, and methods used to define and assess minimal important change and difference in health outcome.

METHOD

A narrative review of the literature, guided by a conceptual framework.

RESULTS

We distinguish between (i) interpretation of health outcome in individuals versus groups, (ii) change within individuals or groups versus difference between change within individuals or groups; and (iii) the responder approach (based on the proportion of patients that obtain a defined response) versus the group average approach (based on the average amount of change in a group). We review approaches, concepts, and methods.

CONCLUSION

By bringing together and juxtaposing various approaches, concepts, and methods, we set a precursory step in the direction of consensus building in the field concerned with defining and assessing minimal important change and difference in health outcome. We emphasize the need for conceptual clarification and terminological standardization. We argue that assessing minimal importance of change and difference in health outcome is essentially a value judgment involving a range of considerations and perspectives.

Estimating individual health-related quality of life changes in low back pain patients

BACKGROUND

There is a need to evaluate different options for estimating individual change in health-related quality of life for patients with low back pain.

METHODS

Secondary analysis of data collected at baseline and 6 weeks later in a randomized trial of 749 adults with low back pain receiving usual medical care (UMC) or UMC plus chiropractic care at a small hospital at a military training site or two large military medical centers. The mean age was 31; 76% were male and 67% were White. The study participants completed the Patient-Reported Outcomes Measurement Information System (PROMIS®)-29 v 1.0 physical function, pain interference, pain intensity, fatigue, sleep disturbance, depression, anxiety, satisfaction with participation in social roles, physical summary, and mental health summary scores (T-scored with mean = 50 and standard deviation (SD) = 10 in the U.S. general population).

RESULTS

Reliability estimates at the baseline ranged from 0.700 to 0.969. Six-week test-retest intraclass correlation estimates were substantially lower than these estimates: the median test-retest intraclass correlation for the two-way mixed-effects model was 0. 532. Restricting the test-retest reliability estimates to the subset who reported they were about the same as at baseline on a retrospective rating of change item increased the median test-retest reliability to 0.686. The amount of individual change that was statistically significant varied by how reliability was estimated, and which SD was used. The smallest change needed was found when internal consistency reliability and the SD at baseline were used. When these values were used, the amount of change needed to be statistically significant (p < .05) at the individual level ranged from 3.33 (mental health summary scale) to 12.30 (pain intensity item) T-score points.

CONCLUSIONS

We recommend that in research studies estimates of the magnitude of individual change needed for statistical significance be provided for multiple reliability and standard deviation estimates. Whenever possible, patients should be classified based on whether they 1) improved significantly and perceived they got better, 2) improved significantly but did not perceive they were better, 3) did not improve significantly but felt they got better, or 4) did not improve significantly or report getting better.

Novel clinically meaningful scores for the ICIQ-UI-SF and ICIQ-FLUTS questionnaires in women with stress incontinence

AIM

To establish, for the first time, the clinically important differences for the ICIQ-UI-SF and ICIQ-FLUTS questionnaires following surgical and conservative treatments for stress-predominant urinary incontinence in women.

METHODS

Data from the SIMS and OPAL randomised controlled trials were analysed using an anchor-based method. Clinically important difference (CID; score change indicating a successful outcome) and minimal important difference (MID; score change indicating the smallest noticeable difference) were estimated using the PGI-I scale as the anchor.

RESULTS

For ICIQ-UI-SF, following surgical management, CIDs were 5.0 (95%CI 4.3, 5.6) at 1 year and 4.9 points (95%CI 4.2, 5.5) at 3 years, while following conservative management, CIDs were 4.0 (95%CI 3.4, 4.5) at 1 year and 4.6 points (95%CI 4.0, 5.2) at 2 years. For ICIQ-FLUTS, the CID was 3.4 points (95%CI 2.9, 4.0) at 1 year for both surgical and conservative management. MIDs for ICIQ-UI-SF, after surgical treatment, were 4.7 (95% CI 3.2, 6.1) at 1 year and 1.6 points (95%CI -0.2, 3.0) at 3 years, and after conservative treatment they were 1.7 (95% CI 1.0, 2.5) at 1 year and 1.9 points (95%CI 1.1, 2.7) at 2 years. For ICIQ-FLUTS, MIDs were 1.8 (95% CI 0.6, 3.1) at 1 year and 3.2 points (95%CI 2.0, 4.4) at 2 years after surgical treatment, and 1.3 (95%CI 0.6, 1.9) at 1 year and 1.9 points (95%CI 1.1, 2.6) at 2 years after conservative treatment.

CONCLUSION

Our study is the first to establish the CID for the ICIQ-UI-SF and ICIQ-FLUTS that women would associate with a successful outcome 3-years post-surgery and 2-years post-conservative treatment of stress-predominant urinary incontinence. The MID was lower following conservative compared to surgical treatment.

Does orthodontic treatment improve the Oral Health-Related Quality of Life when assessed using the Malocclusion Impact Questionnaire-a 3-year prospective longitudinal cohort study

OBJECTIVES

To assess the change in Oral Health-Related Quality of Life (OHRQoL) following orthodontic treatment using the Malocclusion Impact Questionnaire (MIQ) and to test the responsiveness of MIQ to treatment-associated changes.

METHODS

A longitudinal prospective cohort study, in an orthodontic postgraduate centre, Kerala, India. Patients under 18 years were invited to complete the MIQ before the start of treatment (T0) and 1 month after treatment completion (T1). TheIndex of Orthodontic Treatment Need and Peer Assessment Rating (PAR) scores were assessed at both time periods as well as a global transition judgement at T1.

RESULTS

Two hundred and ten participants were recruited and 162 completed both questionnaires (45.1% males; 54.9% females; age = 12-18 years, mean = 16.8; SD = 1.7). There was large reduction in MIQ scores from T0 (mean = 28.1, SD = 6.1) to T1 (mean = 3.7, SD = 2.6). 53% reported a large improvement in oral health and related life quality after treatment, 32% minimal change, and 15% no change. None reported worsening in OHRQoL at T1. There was a significant positive correlation between change in MIQ score and change in PAR score (r = 0.358), pretreatment aesthetic component (rho = 0.467) and dental health component (rho = 0.491) of the index of orthodontic treatment (IOTN-DHC), and treatment time (rho = 0.502). Regression analysis revealed the change in PAR score and pretreatment IOTN-DHC to be independent predictors of change in MIQ score. Standardized effect size (4.0) and standardized response mean (2.9) were large and the minimal important difference was 7.7. Receiver operating characteristic analysis reported a high diagnostic accuracy of MIQ.

CONCLUSIONS

There was a significant improvement in OHRQoL following orthodontic treatment when assessed using a condition-specific measure for malocclusion. MIQ was found to be responsive to changes associated with orthodontic treatment.

Minimal Clinically Important Difference of Tinnitus Outcome Measurement Instruments-A Scoping Review

OBJECTIVE

Tinnitus assessment and outcome measurement are complex, as tinnitus is a purely subjective phenomenon. Instruments used for the outcome measurement of tinnitus in the context of clinical trials include self-report questionnaires, visual analogue or numeric rating scales and psychoacoustic measurements of tinnitus loudness. For the evaluation of therapeutic interventions, it is critical to know which changes in outcome measurement instruments can be considered as clinically relevant. For this purpose, the concept of the minimal clinically important difference (MCID) has been introduced.

STUDY DESIGN

Here we performed a literature research in PubMed in order to identify for which tinnitus outcome measurements MCID criteria have been estimated and which of these estimates fulfil the current methodological standards and can thus be considered as established.

RESULTS

For most, but not all tinnitus outcome instruments, MCID calculations have been performed. The MCIDs for the Tinnitus Handicap Inventory (THI), the Tinnitus Questionnaire (TQ), the Tinnitus Functional Index (TFI) and visual analogue scales (VAS) vary considerably across studies. Psychoacoustic assessments of tinnitus such as loudness matching have not shown sufficient reliability and validity for the use as an outcome measurement.

CONCLUSION

Future research should aim at the confirmation of the available estimates in large samples involving various therapeutic interventions and under the consideration of time intervals and baseline values. As a rule of thumb, an improvement of about 15% can be considered clinically meaningful, analogous to what has been seen in other entirely subjective pathologies like chronic pain.

Effectiveness of Pulsed Radiofrequency Based on the Minimum Clinically Important Differences in Lumbar Spine-Related Pain in Patients without Recent Lumbar Surgery

BACKGROUND

Pulsed radiofrequency (PRF) has been used for treatment of chronic pain in several body regions, including axial and radicular pain. However, a limited number of reports have specifically demonstrated the effectiveness of PRF for spine-related pain among nonsurgical patients. Therefore, we evaluated the effectiveness of PRF for lumbar spine-associated pain in patients without recent spine surgery, and identified the factors associated with clinically meaningful improvement in pain and quality of life.

METHODS

Records of patients who underwent PRF for lumbar spine-related pain and were followed up over 6 months between 2019 and 2022 were retrospectively reviewed. Data on patient demographics, interventional factors, and patient-reported outcomes, such as the numerical rating scale (NRS) and EuroQol Group 5 Dimension 5-Level Quality of Life (EQ-5D-5 L), were collected. Patients were divided into 2 groups (responsive and nonresponsive) based on the NRS and EQ-5D-5 L scores using the previously reported minimal clinically important difference values of the NRS and EQ-5D-5 L as cutoffs, and baseline parameters were compared to identify contributing factors.

RESULTS

Forty-three patients were included in the final analysis. The NRS and EQ-5D-5 L scores improved significantly at 3 and 6 months after PRF compared to baseline. The groups with NRS and EQ-5D-5 L improvement over the minimal clinically important difference had significantly higher baseline NRS and EQ-5D-5 L scores.

CONCLUSIONS

Our results demonstrated that PRF improved pain and patient-reported outcomes for spine-related pain for at least 6 months in our patient cohort. PRF may be a good option for treating lumbar spine-related issues, even with severe pain and/or dysfunction.

Dual task measures in older adults with and without cognitive impairment: response to simultaneous cognitive-exercise training and minimal clinically important difference estimates

BACKGROUND

Responsiveness and minimal clinically important difference (MCID) are critical indices to understand whether observed improvement represents a meaningful improvement after intervention. Although simultaneous cognitive-exercise training (SCET; e.g., performing memory tasks while cycling) has been suggested to enhance the cognitive function of older adults, responsiveness and MCID have not been established. Hence, we aimed to estimate responsiveness and MCIDs of two dual task performance involving cognition and hand function in older adults with and without cognitive impairment and to compare the differences in responsiveness and MCIDs of the two dual task performance between older adults with and without cognitive impairment.

METHODS

A total of 106 older adults completed the Montreal Cognitive Assessment and two dual tasks before and after SCET. One dual task was a combination of Serial Sevens Test and Box and Block Test (BBT), and the other included frequency discrimination and BBT. We used effect size and standardized response mean to indicate responsiveness and used anchor- and distribution-based approaches to estimating MCID ranges. When conducting data analysis, all participants were classified into two cognitive groups, cognitively healthy (Montreal Cognitive Assessment ≥ 26) and cognitively impaired (Montreal Cognitive Assessment < 26) groups, based on the scores of the Montreal Cognitive Assessment before SCET.

RESULTS

In the cognitively healthy group, Serial Seven Test performance when tasked with BBT and BBT performance when tasked with Serial Seven Test were responsive to SCET (effect size = 0.18-0.29; standardized response mean = 0.25-0.37). MCIDs of Serial Seven Test performance when tasked with BBT ranged 2.09-2.36, and MCIDs of BBT performance when tasked with Serial Seven Test ranged 3.77-5.85. In the cognitively impaired group, only frequency discrimination performance when tasked with BBT was responsive to SCET (effect size = 0.37; standardized response mean = 0.47). MCIDs of frequency discrimination performance when tasked with BBT ranged 1.47-2.18, and MCIDs of BBT performance when tasked with frequency discrimination ranged 1.13-7.62.

CONCLUSIONS

Current findings suggest that a change in Serial Seven Test performance when tasked with BBT between 2.09 and 2.36 corrected number (correct responses - incorrect responses) should be considered a meaningful change for older adults who are cognitively healthy, and a change in frequency discrimination performance when tasked with BBT between 1.47 and 2.18 corrected number (correct responses - incorrect responses) should be considered a meaningful change for older adults who are cognitively impaired. Clinical practitioners may use these established MCIDs of dual tasks involving cognition and hand function to interpret changes following SCET for older adults with and without cognitive impairment.

TRIAL REGISTRATION

NCT04689776, 30/12/2020.

Responsiveness of the Reaching Performance Scale for Stroke

OBJECTIVE

The objective of the study was to estimate the internal and external responsiveness of the Reaching Performance Scale for Stroke (RPSS) in individuals with stroke.

DESIGN

Retrospective analysis of data from 4 randomized controlled trials.

SETTING

Recruitment locations spanning rehabilitation centers and hospitals in Canada, Italy, Argentina, Peru, and Thailand.

PARTICIPANTS

Data from 567 participants (acute to chronic stroke; N=567) were available.

INTERVENTIONS

All 4 studies involved training using virtual reality for upper limb rehabilitation.

MAIN OUTCOME MEASURES

RPSS and upper extremity Fugl-Meyer Assessment (FMA-UE) scores. Responsiveness was quantified for all data and across different stages of stroke. Internal responsiveness of the RPSS was quantified as effect-sizes calculated using post and preintervention change data. External responsiveness was quantified using orthogonal regressions between FMA-UE and RPSS scores. The area under the Receiver Operating Characteristic curve (AUC) was quantified based on the ability of RPSS scores to detect change above FMA-UE minimal clinically important different values across different stages of stroke.

RESULTS

The RPSS had high internal responsiveness overall and across the acute or subacute and chronic stages of stroke. For external responsiveness, orthogonal regression analyses indicated that change in FMA-UE scores had positive moderate correlations with both RPSS Close and Far Target scores for all data and across the acute or subacute and chronic stages of stroke (0.6

CONCLUSIONS

In addition to being reliable and valid, the RPSS is also responsive. Along with the FMA-UE, using RPSS scores can help present a more comprehensive picture of motor compensations to characterize poststroke upper limb motor improvement.

Collapse

Key Words

• Movement quality
• cerebrovascular accident
• compensation
• outcomes
• reaching
• restitution or true recovery
• upper limb

Collapse

MESH Headings

• Humans
• Disability Evaluation
• Recovery of Function
• Retrospective Studies
• Stroke
• Stroke Rehabilitation
• Upper Extremity
• Randomized Controlled Trials as Topic

Collapse

Grants Collapse

Affiliation(s)

Sandeep K Subramanian Departments of Physical Therapy, Physician Assistant Studies and Rehabilitation Medicine, University of Texas Health San Antonio, San Antonio, TX
Gita Margolese School of Physical and Occupational Therapy, McGill University, Montreal, Canada; Centre for Interdisciplinary Research in Rehabilitation, Montreal, Canada
Andrea Turolla Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy; Laboratory of Rehabilitation Technologies, Hospital San Camillo IRCCS, Venice, Italy
Gustavo Saposnik Stroke Outcomes and Decision Neuroscience Unit, Unity Health Toronto, University of Toronto, Toronto, Canada
Mindy F Levin School of Physical and Occupational Therapy, McGill University, Montreal, Canada; Centre for Interdisciplinary Research in Rehabilitation, Montreal, Canada.

Collapse

Collaborators Collapse

Three-Dimensional Preoperative Planning Software for Hip Resurfacing Arthroplasty

Three-dimensional planning of hip arthroplasty is associated with better visualisation of anatomical landmarks and enhanced mapping for preoperative implant sizing, which can lead to a decrease in surgical time and complications. Despite the advantages of hip resurfacing arthroplasty (HRA), it is considered a technically challenging procedure and associated with inaccurate implant placement. This study aimed to examine the validity, reliability, and usability of preoperative 3D Hip Planner software for HRA. Fifty random cases of various hip osteoarthritis severity were planned twice by two junior trainees using the 3D Hip Planner within a one-month interval. Outcome measures included femoral/cup implant size, stem-shaft angle, and cup inclination angle, and were assessed by comparing outcomes from 2D and 3D planning. An adapted unified theory of acceptance and use of technology (UTAUT) survey was used for software usability. Bland-Altman plots between 3D and 2D planning for stem-shaft and inclination angles showed mean differences of 0.7 and -0.6, respectively (r = 0.93, p < 0.001). Stem-shaft and inclination angles showed inter-rater reliability biases of around -2° and 3°, respectively. Chi-square and Pearson's correlation for femoral implant size showed a significant association between the two assessors (r = 0.91, p < 0.001). The 3D test-retest coefficient of repeatability for stem-shaft and inclination angles were around ±2° and ±3°, respectively, with a strong significant association for femoral implant size (r = 0.98, p < 0.001). Survey analyses showed that 70-90% agreed that 3D planning improved expectancy in four domains. 3D hip planner appears to be valid and reliable in preoperative HRA and shows significant potential in optimising the quality and accuracy of surgical planning.

Clinimetric properties of the Perme Intensive Care Unit Mobility Score -a multicenter study for minimum important difference and responsiveness analysis

Background

The use of instruments in clinical practice with measurement properties tested is highly recommended, in order to provide adequate assessment and measurement of outcomes.

Objective

To calculate the minimum clinically important difference (MCID) and responsiveness of the Perme Intensive Care Unit Mobility Score (Perme Score).

Methods

This retrospective, multicentric study investigated the clinimetric properties of MCID, estimated by constructing the Receiver Operating Characteristic (ROC). Maximizing sensitivity and specificity by Youden's, the ROC curve calibration was performed by the Hosmer and Lemeshow goodness-of-fit test. Additionally, we established the responsiveness, floor and ceiling effects, internal consistency, and predictive validity of the Perme Score.

Results

A total of 1.200 adult patients records from four mixed general intensive care units (ICUs) were included. To analyze which difference clinically reflects a relevant evolution we calculated the area under the curve (AUC) of 0.96 (95% CI: 0.95-0.98), and the optimal cut-off value of 7.0 points was established. No substantial floor (8.8%) or ceiling effects (4.9%) were observed at ICU discharge. However, a moderate floor effect was observed at ICU admission (19.3%), in contrast to a very low incidence of ceiling effect (0.6%). The Perme Score at ICU admission was associated with hospital mortality, OR 0.86 (95% CI: 0.82-0.91), and the predictive validity for ICU stay presented a mean ratio of 0.97 (95% CI: 0.96-0.98).

Conclusion

Our findings support the establishment of the minimum clinically important difference and responsiveness of the Perme Score as a measure of mobility status in the ICU.

Canadian multidisciplinary expert consensus on the use of biologics in upper airways: a Delphi study

BACKGROUND

Chronic rhinosinusitis with nasal polyposis (CRSwNP) often coexists with lower airway disease. With the overlap between upper and lower airway disease, optimal management of the upper airways is undertaken in conjunction with that of the lower airways. Biologic therapy with targeted activity within the Type 2 inflammatory pathway can improve the clinical signs and symptoms of both upper and lower airway diseases. Knowledge gaps nevertheless exist in how best to approach patient care as a whole. There have been sixteen randomized, double-blind, placebo-controlled trails performed for CRSwNP targeted components of the Type 2 inflammatory pathway, notably interleukin (IL)-4, IL-5 and IL-13, IL- 5R, IL-33, and immunoglobulin (Ig)E. This white paper considers the perspectives of experts in various disciplines such as rhinology, allergy, and respirology across Canada, all of whom have unique and valuable insights to contribute on how to best approach patients with upper airway disease from a multidisciplinary perspective.

METHODS

A Delphi Method process was utilized involving three rounds of questionnaires in which the first two were completed individually online and the third was discussed on a virtual platform with all the panelists. A national multidisciplinary expert panel of 34 certified specialists was created, composed of 16 rhinologists, 7 allergists, and 11 respirologists who evaluated the 20 original statements on a scale of 1-9 and provided comments. All ratings were quantitively reviewed by mean, median, mode, range, standard deviation and inter-rater reliability. Consensus was defined by relative interrater reliability measures-kappa coefficient ([Formula: see text]) value > 0.61.

RESULTS

After three rounds, a total of 22 statements achieved consensus. This white paper only contains the final agreed upon statements and clear rationale and support for the statements regarding the use of biologics in patients with upper airway disease.

CONCLUSION

This white paper provides guidance to Canadian physicians on the use of biologic therapy for the management of upper airway disease from a multidisciplinary perspective, but the medical and surgical regimen should ultimately be individualized to the patient. As more biologics become available and additional trials are published we will provide updated versions of this white paper every few years.

Effects of non-drug interventions on anxiety and depression in patients with heart failure: A systematic review based on Bayesian network meta-analysis

BACKGROUND

To discuss the effect of non-drug interventions on anxiety and depression in patients with heart failure (HF) through Bayesian network meta-analysis.

METHODS

Relevant literature was searched from PubMed, Web of Science, Embase and Medline from database establishment to October 2022 by a computer. Next, a screening was performed on randomized controlled trials (RCTs) for the effect of non-drug interventions on anxiety and depression in HF patients, followed by a collection of the related data. This meta-analysis was conducted based on Bayesian network, and the statistical analysis was conducted using R4.2 software.

RESULTS

A total of 23 papers were enrolled into this study. The results of Bayesian network meta-analysis showed that compared with the control group and the structured video conferencing support (SVCS) group, telephone case management (TCM) could effectively reduce the anxiety and depression of HF patients. The ranking results revealed that TCM may be the most effective intervention to lower the risk of depression in HF patients, followed by Tai Chi Chuan and Chi Kung training (TCC) and structured telephone support (STS).

CONCLUSION

TCM is the most effective intervention to prevent HF patients from anxiety and depression.

Responsiveness and minimal clinically important difference of EQ-5D-5L in patients with coronary heart disease after percutaneous coronary intervention: A longitudinal study

Background

Although the five-level version of the EuroQol five-dimensional questionnaire (EQ-5D-5L) has been validated in various diseases, no empirical study has evaluated the responsiveness and minimal clinically important difference (MCID) of the instrument in patients with coronary heart disease (CHD), which limits the interpretability and clinical application of EQ-5D-5L. Therefore, this study aimed to determine the responsiveness and MCID of EQ-5D-5L in patients with CHD who underwent percutaneous coronary intervention (PCI) and identify the relationship between the MCID values and minimal detectable change (MDC).

Methods

Patients with CHD were recruited for this longitudinal study at the Tianjin Medical University’s General Hospital in China. At baseline and 4 weeks after PCI, participants completed the EQ-5D-5L and Seattle Angina Questionnaire (SAQ). Additionally, we used the effect size (ES) to assess the responsiveness of EQ-5D-5L. The anchor-based, distribution-based, and instrument-based methods were used in this study to calculate the MCID estimates. The MCID estimates to MDC ratios were computed at the individual and group levels at a 95% CI.

Results

Seventy-five patients with CHD completed the survey at both baseline and follow-up. The EQ-5D-5L health state utility (HSU) improved by 0.125 at follow-up compared with baseline. The ES of EQ-5D HSU was 0.850 in all patients and 1.152 in those who improved, indicating large responsiveness. The average (range) MCID value of the EQ-5D-5L HSU was 0.071 (0.052–0.098). These values can only be used to determine whether the change in scores were clinically meaningful at the group level.

Conclusion

EQ-5D-5L has large responsiveness among CHD patients after undergoing PCI surgery. Future studies should focus on calculating the responsiveness and MCID for deterioration and examining the health changes at the individual level in CHD patients.

Comparison of responsiveness of the Barthel Index and modified Barthel Index in patients with stroke

PURPOSE

To compare the group- and individual-level responsiveness of the Barthel Index (BI) and modified BI (MBI) in patients with early subacute stroke.

MATERIALS AND METHODS

The BI and MBI scores of 63, 63, and 55 patients were retrieved at 3 time points with a 3-weeks interval. The group-level responsiveness was examined using paired t-test and standardized response mean (SRM). The individual-level responsiveness was examined by the percentage of patients who achieved significant improvement exceeding the corresponding minimal detectable change.

RESULTS

At the group level, the MBI showed significantly larger SRMs than did the BI in the 1st-2nd assessment (1.10 vs. 0.81 [95% CI of mean difference = 0.05-0.38]) and the 2nd-3rd assessment (0.94 vs. 0.72 [95% CI of mean difference = 0.04-0.41]). At the individual level, the MBI detected significantly more patients with significant improvement than the BI for the 1st-2nd assessments only (34.9 vs. 25.4% [95% CI of mean differences = 3.2-17.5]).

CONCLUSIONS

The MBI has better responsiveness than the BI at both the group and individual levels in the patients with early subacute stroke. The MBI is recommended for clinical and research use as an outcome measure for patients with stroke.IMPLICATIONS FOR REHABILITATIONThe MBI is recommended for clinical and research applications because of its superior ability to detect subtle changes in ADL performance in patients with subacute stroke.The MBI and the BI have equal responsiveness for patients whose magnitude of improvement of ADL is substantial.

The Minimal Clinically Important Difference Changes Greatly Based on the Different Calculation Methods

BACKGROUND

The minimal clinically important difference (MCID) for patient-reported outcome measures (PROMs) expresses both the extent of the improvement and the value that patients place on it. MCID use is becoming increasingly widespread to understand the clinical efficacy of a given treatment, define guidelines for clinical practice, and properly interpret trial results. However, there is still large heterogeneity in the different calculation methods.

PURPOSE

To calculate and compare the MCID threshold values of a PROM by applying various methods and analyzing their effect on the study results interpretation.

STUDY DESIGN

Cohort study (Diagnosis); Level of evidence, 3.

METHODS

The data set used to investigate the different MCID calculation approaches was based on a database of 312 patients affected by knee osteoarthritis and treated with intra-articular platelet-rich plasma. MCID values were calculated on the International Knee Documentation Committee (IKDC) subjective score at 6 months using 2 approaches: 9 methodologies referred to an anchor-based approach and 8 methodologies to a distribution-based approach. The obtained threshold values were applied to the same series of patients to understand the effect of using different MCID methods in evaluating patient response to treatment.

RESULTS

The different methods employed led to MCID values ranging from 1.8 to 25.9 points. The anchor-based methods ranged from 6.3 to 25.9, while the distribution-based ones were from 1.8 to 13.8 points, showing a 4.1× variation of the MCID values within the anchor-based methods and a 7.6× variation within the distribution-based methods. The percentage of patients who reached the MCID for the IKDC subjective score changed based on the specific calculation method used. Among the anchor-based methods, this value varied from 24.0% to 66.0%, while among the distribution-based methods, the percentage of patients reaching the MCID varied from 44.6% to 75.9%.

CONCLUSION

This study proved that different MCID calculation methods lead to highly heterogeneous values, which significantly affect the percentage of patients achieving the MCID in a given population. The wide-ranging thresholds obtained with the different methodologies make it difficult to evaluate the real effectiveness of a given treatment questioning the usefulness of MCID, as currently available, in the clinical research.

Establishing Responsiveness and Minimal Clinically Important Difference of Quebec Back Pain Disability Scale (Hindi Version) in Chronic Low Back Pain Patients Undergoing Multimodal Physical Therapy

Increasing emphasis is placed on physical functional measures to examine treatments for chronic low back pain (CLBP). The Quebec Back Pain Disability Scale (Hindi version) (QBPDS-H) has never been evaluated for responsiveness. The objectives of this study were to (1) examine the internal and external responsiveness of the Quebec Back Pain Disability Scale (Hindi version) (QBPDS-H) and (2) find out the minimal clinically important difference (MCID) and minimal detectable change (MDC) in the functional ability of patients with chronic low back pain (CLBP) undergoing multimodal physical therapy treatment. In this prospective cohort study, QBPDS-H responses were recorded at the baseline and after eight weeks from 156 CLBP patients undergoing multimodal physiotherapy treatment. To differentiate between the clinically unimproved (n = 65, age: 44.16 ± 11.8 years) and clinically improved (n = 91, age: 43.28 ± 10.7 years) scores of patients from the initial assessment to the last follow-up, the Hindi version of the Patient's Global Impression of Change (H-PGIC) scale was utilized. Internal responsiveness was large (E.S. (pooled S.D.) (n = 91): 0.98 (95% CI = 1.14-0.85) and Standardized Response Mean (S.R.M.) (n = 91): 2.57 (95% CI = 3.05-2.17)). In addition, the correlation coefficient and receiver operative characteristics (R.O.C.) curve were used to assess the QBPDS-H external responsiveness. MCID and MDC were detected by the R.O.C. curve and standard error of measurements (S.E.M.), respectively. The H-PGIC scale showed moderate responsiveness (ρ = 0.514 and area under the curve (A.U.C.) = 0.658; 95% CI, 0.596-0.874), while the MDC achieved 13.68 points, and the MCID was found have 6 points (A.U.C. = 0.82; 95% CI: 0.74-0.88, sensitivity = 90%, specificity = 61%). This study shows that QBPDS-H has moderate levels of responsiveness in CLBP patients receiving multimodal physical therapy treatment, so it can be used to measure the changes in disability scores. MCID and MDC changes were also reported with QBPDS-H.

Outcomes of periodontal therapy: Strengthening the relevance of research to patients. A co-created review

Periodontitis is a long-term condition affecting up to half of the population globally and causing significant impacts on life quality. Successful management depends on taking life-long ownership of the condition by those affected. There is a wealth of research to inform on management options. However, most of the research has been designed by professional experts with outcomes to gauge benefits and harms based on parameters that inform on the disease process but which might not be informative to support decision-making in people with lived experience (PWLE) of periodontal ill-health (including both patients and carers). The importance of relevant outcomes is highlighted in the concept of the "expert patient" which aims to strengthen the capacity of PWLE to make health-care choices that are important for them, elements of which are likely to be already familiar to many clinicians delivering periodontal health care. Therefore, the voice and collaboration of PWLE in research are recognised as crucial to developing high quality, relevant evidence especially for long-term conditions. In this paper, we review what is known about the relevance of treatment outcomes to PWLE. We also examine the degree to which PWLE have been involved in identifying outcomes that are important to them as well as the diversity and therefore representativeness of PWLE recruited for studies. We consider why having more relevant outcomes could enhance the expertise of PWLE in managing their periodontitis. We then conclude with key learnings from our review which we hope will encourage more rapid development of these initiatives in periodontology for the benefit of global health and wellbeing.

Digital self-report instruments for repeated measurement of mental health in the general adult population: a protocol for a systematic review

INTRODUCTION

Digital technologies present tremendous opportunities for enabling long-term measurement of mental health in the general population. Emerging studies have established preliminary efficacy of collecting self-report data digitally. However, a key challenge when developing a new self-report instrument is navigating the abundance of existing instruments to select relevant constructs for measurements. This review is a precursor to developing a novel future integrated digital instrument for repeated measurements. We interrogate the literature as the first step towards optimal measurement of the multifaceted mental health concept, in the context of digital repeated measurement. This review aims to identify (1) digital self-report instruments administered repeatedly to measure the mental health of the general adult population; (2) their structure and format; (3) their psychometric properties; (4) their usage in empirical studies; and (5) the constructs these instruments were designed to measure (as characterised in the original publication), and the constructs the instruments have been used to measure in the identified empirical studies.

METHODS AND ANALYSIS

Five major electronic databases will be searched. Studies administering mental health instruments (in English) repeatedly to community dwellers in the general adult population are eligible. A reviewer will preliminarily screen for eligible studies. Then, two reviewers will independently screen the full text of the eligible articles and extract data. Both reviewers will resolve any disagreement through discussion or with a third reviewer. After the data extraction, a reviewer will manually search for the structure, format, psychometric properties and the original constructs these instruments were developed to measure. This review will synthesise the results in a narrative approach. The reporting in this review will be guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses checklist.

ETHICS AND DISSEMINATION

Ethical approval is not required as no data will be collected. Findings of the systematic review will be disseminated through peer-reviewed publications and conference presentations.

PROSPERO REGISTRATION NUMBER

CRD42022306547.

Magnitude and relevance of change in health-related quality of life in patients with vascular malformations treated with sirolimus

Introduction

Vascular malformations are rare congenital anomalies of the vascular system, which can involve the capillaries, veins, arteries, lymphatics, or a combination of vessel types. Patients with vascular malformations experience an impaired health-related quality of life (HRQoL) because of their symptoms (e.g., pain, swelling, and bleeding) and psychosocial distress. Sirolimus is an effective drug used in the medical treatment of these patients; however, relatively little is known about the effect of sirolimus on specific changes in the HRQoL domains and its magnitude.

Methods

The magnitude of change (effect size) following intervention is more informative to clinical practitioners than statistically significant but clinically unimportant changes; therefore, this study aimed to examine the magnitude and meaningfulness of change in the HRQoL of children and adults with vascular malformations following sirolimus treatment using low target levels.

Results

In total, 50 patients with vascular malformations (19 children, 31 adults) were included in this study. These patients experienced a lower HRQoL than the general population, with the adults reporting a significantly lower score in almost all domains. A 6-month sirolimus treatment improved the HRQoL in 29 patients, including 77.8% of the children (Pediatric Quality of Life Inventory score [PedsQL]) and 57.7% of the adults (Short Form 36 [SF-36]). The effect sizes of sirolimus for each SF-36/PedsQL domain ranged from 0.19 to 1.02. The clinically relevant moderate magnitude of changes was seen in the domains of the children's reports: "Physical functioning" and "Social functioning" and in the domains of the parent reports: "Social functioning," "School functioning," and "Psychosocial." A high-magnitude change was seen in the domains "Emotional functioning" and "Psychosocial" in the children's reports and "Physical functioning" in the parent reports. In addition, the moderate magnitude of changes was also seen in the adults SF-36: in all domains except for "Role limitations-physical problems," "Role limitations-emotional problems," and "General health perception."

Conclusion

We believe this is the first study showing the magnitude of change in HRQoL after sirolimus treatment in patients with vascular malformations. Before treatment, these patients experienced an impaired HRQoL compared with the general Dutch population. A 6-month sirolimus treatment with low target levels led to moderate-to-high clinically relevant changes in multiple domains, which significantly improved the HRQoL.

Clinical trial registration

https://clinicaltrials.gov/ct2/show/NCT03987152?cond=Vascular+Malformations&cntry=NL&city=Nijmegen&draw=2&rank=1, identifier: NCT03987152.