Primary outcome measures used in interventional trials for ankle fractures: a systematic review

Validation of the Ankle Ligament Reconstruction-Return to Sports after Injury (ALR-RSI) Score as a Tool to Assess Psychological Readiness to Return to Sport in an Active Population After Ankle Fracture Surgery: A Cross-sectional Study

Ankle injuries account for 15% to 25% of all sports injuries resulting in significant pain and loss of function. The purpose of this cross-sectional study was to validate a scale to help surgeons quantify the psychological readiness to Return To Sport (RTS) in patients undergoing ankle fracture surgery. ALR-RSI was used to assess the psychological readiness for RTS in athletic patients who underwent ankle fracture fixation between January 2020 and January 2021. Participants filled out ALR-RSI and 2 Patient-Related Outcome Measurement (PROM) tools: Olerud-Molander Ankle Score (OMAS) and Self-Reported Foot and Ankle Score (SEFAS). A total of 93 patients were included. There was a strong correlation between ALR-RSI and both OMAS and SEFAS, with Pearson coefficients of r = 0.58 and 0.53, respectively. ALR-RSI was significantly higher in the RTS group than in those who no longer practiced their main preinjury sport. Moreover, the discriminant validity of ALR-RSI (AUC = 0.81) was better than that of the SEFAS and OMAS (AUC = 0.64 and 0.65, respectively, p = .001). The intra-class correlation coefficient ρ of 0.94 showed excellent reproducibility. At an optimal cutoff value of 76.7, ALR-RSI had a sensitivity of 81% and a specificity of 75% with a Youden index of 0.56. In conclusion, ALR-RSI was a valid and reproducible tool to evaluate the psychological readiness for RTS in an active population after an ankle fracture. This score could help surgeons identify athletes who may have unfavorable postoperative outcomes and provide support on the ability to RTS.

Assessing the content validity of the Manchester-Oxford Foot Questionnaire in surgically treated ankle fracture patients: a qualitative study

BACKGROUND

Roughly 10% of fractures in adults are ankle fractures. These injuries are found in both sexes and present with different fracture characteristics. The treatment varies with the patients' biology and fracture type, and the goals are to restore stability, prevent pain and maintain ankle function. Clinicians generally use outcomes like assessment of radiography, pain level, or function. The use of patient-reported outcome measures is increasing, and the Manchester-Oxford Foot Questionnaire (MOXFQ) has been shown to have good measurement properties when validated in patients with foot and ankle disorders. However, the instrument has not been validated for ankle fracture patients. This study aims to assess the content validity of the items in MOXFQ in surgically treated ankle fracture patients.

METHODS

A qualitative deductive design was used to investigate patients' response process of the MOXFQ. Individual interviews were conducted using cognitive interviewing based on the theoretical framework of the 4-step model by Tourangeau. Adult patients that were surgically treated for an ankle fracture between four weeks and 18 months were purposively sampled, and interviews followed a semi-structured interview guide. The predetermined categories were comprehension, retrieval, judgement, and response.

RESULTS

Seventeen respondents (65% females) were interviewed. Respondents' age ranged from 27 to 76 years. Some of the respondents in the early recovery phase were limited by post-operative restrictions and did not find the items in the walking/standing domain relevant. Respondents that were allowed weight-bearing as tolerated (WBAT) were able to recall relevant information for most items. Respondents with time since surgery more than 12 months had less pain and remembered fewer relevant episodes in the recall period. Items in the social interaction domain contained ambiguous questions and were generally considered less important by respondents. The summary index score lacked important concepts in measuring overall quality of life.

CONCLUSIONS

Pain was a central concept in the post-operative recovery of ankle fracture patients. The MOXFQ-subscales for pain and walking/standing had acceptable content validity in patients that were allowed WBAT. The social interaction-subscale and the summary index score had insufficient content validity for this patient population.

Clinical outcomes of ankle fractures in sub-Saharan Africa: a systematic review

PURPOSE

Ankle fractures may cause disability and socioeconomic challenges, even when managed in a high-resource setting. The outcomes of ankle fractures in sub-Saharan Africa are not widely reported. We present a systematic review of the patient-reported outcomes and complications of patients treated for ankle fractures in sub-Saharan Africa.

METHODS

Medline, Embase, Google Scholar and the Cochrane Central Register of Controlled Trials were searched, utilising MeSH headings and Boolean search strategies. Ten papers were included. Data included patient demographics, surgical and non-surgical management, patient-reported outcome measures and evidence of complications.

RESULTS

A total of 555 patients with ankle fractures were included, 471 of whom were followed up (range 6 weeks-73 months). A heterogenous mix of low-quality observational studies and two methodologically poor-quality randomised trials demonstrated mixed outcomes. A preference for surgical management was found within the published studies with 87% of closed fractures being treated operatively. A total of five different outcome scoring systems were used. Most studies included in this review were published by well-resourced organisations and as such are not representative of the actual clinical practice taking place.

CONCLUSION

The literature surrounding the clinical outcomes of ankle fractures in sub-Saharan Africa is sparse. There appears to be a preference for surgical fixation in the published literature and considering the limitations in surgical resources across sub-Saharan Africa this may not be representative of real-life care in the region.

Ankle fractures: a systematic review of patient-reported outcome measures and their measurement properties

PURPOSE

Ankle fractures are commonly occurring fractures, especially in the aging population, where they often present as fragility fractures. The disease burden and economic costs to the patient and society are considerable. Choosing accurate outcome measures for the evaluation of the management of ankle fractures in clinical trials facilitates better decision-making. This systematic review assesses the evidence for the measurement properties of patient-reported outcome measures (PROMs) used in the evaluation of adult patients with ankle fractures.

METHODS

Searches were performed in CINAHL, EMBASE, Medline and Google Scholar from the date of inception to July 2021. Studies that assessed the measurement properties of a PROM in an adult ankle fracture population were included. The included studies were assessed according to the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) methodology for systematic reviews of PROMs.

RESULTS

In total, 13 different PROMs were identified in the 23 included articles. Only the Ankle Fracture Outcome of Rehabilitation Measure (A-FORM) presented some evidence on content validity. The Olerud-Molander Ankle Score (OMAS) and Self-reported Foot and Ankle Score (SEFAS) displayed good evidence of construct validity and internal consistency. The measurement properties of the OMAS, LEFS and SEFAS were most studied.

CONCLUSION

The absence of validation studies covering all measurement properties of PROMs used in the adult ankle fracture population precludes the recommendation of a specific PROM to be used in the evaluation of this population. Further research should focus on validation of the content validity of the instruments used in patients with ankle fractures.

A systematic review of outcome reporting in clinical trials of distal tibia and ankle fractures

Aims

To describe outcome reporting variation and trends in non-pharmacological randomized clinical trials (RCTs) of distal tibia and/or ankle fractures.

Methods

Five electronic databases and three clinical trial registries were searched (January 2000 to February 2022). Trials including patients with distal tibia and/or ankle fractures without concomitant injuries were included. One reviewer conducted all searches, screened titles and abstracts, assessed eligibility, and completed data extraction; a random 10% subset were independently assessed and extracted by a second reviewer at each stage. All extracted outcomes were mapped to a modified version of the International Classification of Functioning, Disability and Health framework. The quality of outcome reporting (reproducibility) was assessed.

Results

Overall, 105 trials (n = 16 to 669 participants) from 27 countries were included. Trials compared surgical interventions (n = 62), post-surgical management options (n = 17), rehabilitative interventions (n = 14), surgical versus non-surgical interventions (n = 6), and pre-surgical management strategies (n = 5). In total, 888 outcome assessments were reported across seven domains: 263 assessed body structure or function (85.7% of trials), 136 activities (68.6% of trials), 34 participation (23.8% of trials), 159 health-related quality of life (61.9% of trials), 247 processes of care (80% of trials), 21 patient experiences (15.2% of trials), and 28 economic impact (8.6% of trials). From these, 337 discrete outcomes were described. Outcome reporting was inconsistent across trials. The quality of reporting varied widely (reproducibility ranged 4.8% patient experience to 100% complications).

Conclusion

Substantial heterogeneity in outcome selection, assessment methods, and reporting quality were described. Despite the large number of outcomes, few are reported across multiple trials. Most outcomes are clinically focused, with little attention to the long-term consequences important to patients. Poor reporting quality reduces confidence in data quality, inhibiting data synthesis by which to inform care decisions. Outcome reporting guidance and standardization, which captures the outcomes that matter to multiple stakeholders, are urgently required. Cite this article: Bone Jt Open 2022;3(10):832–840.

The minimal clinically important difference (MCID) of the Olerud Molander Ankle Score (OMAS) in patients with unstable ankle fracture

INTRODUCTION

The Olerud Molander Ankle Score (OMAS) is a widely used validated Patient Reported Outcome Measure (PROM). For clinical research, it is important to determine the Minimal Clinically Important Difference (MCID). The objective of this study was to determine the MCID of the OMAS at several moments in the follow-up, in a cohort of patients that underwent open reduction and internal fixation of unstable ankle fractures with syndesmotic injury.

MATERIALS AND METHODS

Data for this descriptive study were extracted from a prospective randomized controlled trial, the RODEO trial. The Dutch version of the OMAS was completed at 3, 6 and 12-month follow-up and estimated at baseline. The used anchor-based methods were: mean change and ROC curve. The distribution-based methods were: 0.5SD and minimal detectable change (MDC).

RESULTS

This cohort included 148 patients. The mean OMAS score in the group with minimal improvement between 3 and 6 months was 15.0 (SD 17.5, 95%CI 9.4-20.6) and between 6 and 12 months 9.5 (SD 17.1, 95% CI 3.1-15.9). The ROC curve between 3 and 6 months resulted in a MCID of 12.5 (AUC 0.72) and between 6 and 12 months, the MCID was 7.5 (AUC 0.78). Using 0.5 SD, the MCID was 10.52 (SD 21.04) at 3 months, 11.37 (SD 22.73) at 6 months and 10.47 (SD 20.94) at 12 months. The MDC was 4.72 at 3 months, 5.20 at 6 months and 4.71 at 12 months.

CONCLUSIONS

The calculated MCID in patients following surgery for unstable ankle fractures ranges from 10.5 to 15.0 at 3-6-month follow-up and from 7.5 to 11.4 at 6-12-month follow-up, depending on moment and method.

The association between person and fracture characteristics with patient reported outcome after ankle fractures in adults: A systematic review

BACKGROUND

The incidence of ankle fractures is increasing and the clinical outcome is highly variable.

QUESTION

What person and fracture characteristics are associated with patient reported outcomes after surgically or conservatively managed ankle fractures in adults?

DATA SOURCES

Medline, EMBASE, and Allied and Complimentary Health Medical Database (AMED) databases were searched from the earliest available date until 16th July 2020.

STUDY SELECTION

Prognostic factors studies recruiting adults of age 18 years or older with a radiologically confirmed ankle fracture, and evaluating function, symptoms and quality of life by patient reported outcome measures, were included.

STUDY APPRAISAL/SYNTHESIS METHODS

Risk of bias of individual studies was assessed by the Quality in Prognostic Factors Studies tool. Correlation coefficients were calculated and data were analysed using narrative synthesis.

RESULTS

Fifty-one phase 1 explanatory studies with 6177 participants met the inclusion criteria. Thirty-one studies were rated as high risk of bias using the Quality in Prognostic Factors Studies tool. There was low quality evidence that age, body mass index, American Society of Anesthesiologists classification and pre-injury mobility were associated with function, and low to moderate quality evidence that age, smoking and American Society of Anesthesiologists classification were associated with quality of life. No person characteristics were associated with symptoms and no fracture characteristics were associated with any outcomes.

CONCLUSION

There was low to moderate quality evidence that person characteristics may be associated with patient reported function and quality of life following ankle fracture.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO registration number CRD42020184830.

Recovery and Return to Activity 1 Year After Ankle Fracture Managed With Open Reduction and Internal Fixation: A Prospective Longitudinal Cohort Study

Background:

Ankle fractures are common and frequently managed with open reduction and internal fixation (ORIF). Although these fractures can occur at any age, they are most common in younger individuals with high-energy trauma or older adults with lower-energy trauma. Our investigation focused on those aged 65 years or younger. Our primary objective was to describe recovery over the first postfracture year in (1) functional dorsiflexion using the weightbearing lunge test (WBLT), (2) patient-reported functional outcomes using the Olerud Molander Ankle Score (OMAS), (3) return to prefracture activity levels, and (4) return to work. Secondarily, we examined patient and clinical factors (including the WBLT and OMAS) associated with return to prefracture activities, including sports.

Methods:

Using a prospective inception cohort of 142 patients between 18 and 65 years old who underwent ORIF after ankle fracture and attended follow-up visits, we collected information from participants and their medical charts. We assessed functional dorsiflexion (using side-to-side difference in WBLT), patient-reported functional outcome (OMAS), and self-reported return to prefracture activity levels and work at 6 weeks, 6 months and 1 year postoperatively.

Results:

The WBLT, OMAS, and return to prefracture activity and work improved significantly over time ( P < .001). However, at 1 year postoperation, the mean side-to-side difference in the WBLT was 3.22±2.68 cm, 69 (72%) reported ankle stiffness, and only 49 (52%) had returned to prefracture activity levels. Of those who were working, 97% had returned to work by 1 year postoperation. Only the OMAS ( P < .001) and side-to-side difference in WBLT ( P = .011) were significantly associated with return to prefracture activity levels.

Conclusion:

Although participants improved significantly over the first postoperative year in all outcomes, many reported limitations in functional dorsiflexion and return to prefracture activities. Those with higher OMAS scores and smaller side-to-side difference in WBLT were more likely to return to prefracture activity levels by 1 year postoperatively. Level of Evidence: Level II, prognostic study.

The Value of Additional Gravity Stress Radiographs for Decision Making in the Treatment of Isolated Type B Distal Fibular Fractures

BACKGROUND

Prior to treatment decisions concerning isolated Weber type B ankle fractures, assessment of the stability of the ankle joint is mandatory. The gravity stress (GS) radiograph is a radiographic tool to determine stability. We hypothesized that this additional GS radiograph would lead to fewer operative treatments by applying the criterion of operative treatment when medial clear space (MCS) > superior clear space (SCS) + 2 mm on the GS radiograph, compared with the nonstressed mortise view criteria of advising operative treatment in case of MCS > SCS + 1 mm.

METHODS

This retrospective comparative cohort study analyzed 343 patients aged between 18 and 70 years with an isolated Weber type B ankle fracture diagnosed at the emergency department between January 2014 and December 2019. The cohort was divided into 2 groups based on whether an additional GS radiograph was performed. Group I consisted of 151 patients in whom a regular mortise and lateral radiograph were performed. Group II comprised 192 patients, with an additional GS radiograph. Primary outcome was type of treatment (conservative vs operative). Secondary outcomes were patient-reported functional outcomes and pain.

RESULTS

Baseline characteristics of both groups did not differ. In group I, surgery was performed in 60 patients (39.7%) compared with 108 patients (56.3%) in group II (P = .002). In the operatively treated patients, the mean MCS on regular mortise view was significantly smaller in patients in whom an additional GS radiograph was performed compared to patients without an additional GS radiograph (4.1 mm vs 5.2 mm, P < .001). Mean Olerud-Molander Ankle Score and mean visual analog scale (VAS) for pain did not differ significantly between groups I and II.

CONCLUSIONS

Contrary to what was hypothesized, the introduction of an additional gravity stress radiograph, by which operative treatment was indicated if the MCS was wider than the SCS + 2 mm, did not result in reduced operative treatment of Weber type B ankle fractures when operative treatment was indicated for MCS > SCS + 1 mm on non-gravity stress radiographs.

LEVEL OF EVIDENCE

Level III: retrospective comparative study.

Co-producing a multi-stakeholder Core Outcome Set for distal Tibia and Ankle fractures (COSTA): a study protocol

BACKGROUND

Ankle fracture is a common injury with a strong evidence base focused on effectiveness of treatments. However, there are no reporting guidelines on distal tibia and ankle fractures. This has led to heterogeneity in outcome reporting and consequently, restricted the contribution of evidence syntheses. Over the past decade, core outcome sets have been developed to address this issue and are available for several common fractures, including those of the hip, distal radius, and open tibial fractures. This protocol describes the process to co-produce-with patient partners and other key stakeholders-a multi-stakeholder derived Core Outcome Set for distal Tibia and Ankle fractures (COSTA). The scope of COSTA will be for clinical trials.

METHODS

The study will have five-stages which will include the following: (i) systematic reviews of existing qualitative studies and outcome reporting in randomised controlled trial studies to inform a developing list of potential outcome domains; (ii) qualitative interviews (including secondary data) and focus groups with patients and healthcare professionals to explore the impact of ankle fracture and the outcomes that really matter; (iii) generation of meaningful outcome statements with the study team, international advisory group and patient partners; (iv) a multi-round, international e-Delphi study to achieve consensus on the core domain set; and (v) an evidence-based consensus on a core measurement set will be achieved through a structured group consensus meeting, recommending best assessment approaches for each of the domains in the core domain set.

DISCUSSION

Development of COSTA will provide internationally endorsed outcome assessment guidance for clinical trials for distal tibia and ankle fractures. This will enhance comparative reviews of interventions, potentially reducing reporting bias and research waste.

An evaluation of the measurement properties of the Olerud Molander Ankle Score in adults with an ankle fracture

OBJECTIVES

The aim of this study is to evaluate the measurement properties of the Olerud Molander Ankle Score in adults with an ankle fracture.

METHODS

Patients completed outcome measure questionnaires at baseline, six, 10- and 16-weeks postinjury as part of an ongoing clinical trial on ankle fracture rehabilitation. The internal consistency, convergent validity, structural validity and interpretability of the Olerud Molander Ankle Score was assessed. This was achieved through using the respective analysis methods of Cronbach's alpha, correlation coefficients, principal component analysis, evaluation of floor and ceiling scores and estimation of the minimally important change using anchor-based methods.

RESULTS

The Olerud Molander Ankle Score showed adequate convergent validity against hypotheses set in relation to scores of comparator instruments. Principal component analysis demonstrated that the measure has two subscales: ankle function and ankle symptoms. The internal consistency of the measure and the ankle function subscale was sufficient, but inconclusive for the ankle symptoms subscale. There were no floor and ceiling effects present within the scores and the estimated minimally important change was 9.7 points.

CONCLUSION

The Olerud Molander Ankle Score demonstrates sufficient measurement properties and is likely to be primarily measuring the construct of patient reported function following ankle fracture. Further research should evaluate the relevance of other domains to individuals recovering from and ankle fracture, such as social participation and psychological wellbeing. The development of a core outcome set would be advantageous to standardise outcome measurement collection in this area.

A systematic review of the measurement properties of patient reported outcome measures used for adults with an ankle fracture

BACKGROUND

Ankle fractures are painful and debilitating injuries that pose a significant burden to society and healthcare systems. Patient reported outcome measures (PROMs) are commonly used outcome measures in clinical trials of interventions for ankle fracture but there is little evidence on their validity and reliability. This systematic review aims to identify and appraise evidence for the measurement properties of ankle specific PROMs used in adults with an ankle fracture using Consensus Based Standards for the Selection of Health Measurement Instrument (COSMIN) methodology.

METHODS

We searched MEDLINE, Embase and CINAHL online databases for evidence of measurement properties of ankle specific PROMs. Articles were included if they assessed or described the development of the PROM in adults with ankle fracture. Articles were ineligible if they used the PROM to assess the measurement properties of another instrument. Abstracts without full articles and conference proceedings were ineligible, as were articles that adapted the PROM under evaluation without any formal justification of the changes as part of a cross-cultural validation or translation process. Two reviewers completed the screening. To assess methodological quality we used COSMIN risk of bias checklist and summarised evidence using COSMIN quality criteria and a modified Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach. Two reviewers assessed the methodological quality and extracted the data for a sample of articles.

RESULTS

The searches returned a total of 377 articles. From these, six articles were included after application of eligibility criteria. These articles evaluated three PROMs: A-FORM, OMAS and AAOS. The A-FORM had evidence of a robust development process within the patient population, however lacks post-formulation testing. The OMAS showed sufficient levels of reliability, internal consistency and construct validity. The AAOS showed low quality evidence of sufficient construct validity.

CONCLUSIONS

There is insufficient evidence to support the recommendation of a particular PROM for use in adult ankle fracture research based on COSMIN methodology. Further validation of these outcome measures is required in order to ensure PROMs used in this area are sufficiently valid and reliable to assess treatment effects. This would enable high quality, evidenced-based management of adults with ankle fracture.