Do patients consider computer-adaptive measures more appropriate than static questionnaires?

The Forgotten Joint Score Is a Valid Outcome Measure for Total Ankle Arthroplasty: A Prospective Study

BACKGROUND

The success of total ankle arthroplasty (TAA) involves objective and subjective parameters such as joint motion and implant survival. Patient-reported outcome measures provide key context from the patient's perspective so that we can evaluate the results of these procedures. The Forgotten Joint Score (FJS) has demonstrated validity and reliability in other arthroplasties, but the existing evidence on the FJS in TAA is very limited.

QUESTION/PURPOSES

We aimed to assess the reliability, validity, responsiveness to change, and floor and ceiling effects, as well as to perform a gender analysis, of the FJS in patients who had undergone TAA.

METHODS

A prospective, observational study enrolled patients who underwent TAA at our institution between June 2021 and May 2023. The three-component TAA was performed through an anterior approach. A total of 120 patients (mean age 62 ± 10 years) participated, which was 83% (120 of 145) of those eligible, and 77% (92 of 120) of those patients underwent follow-up assessments at 12 ± 1 months after surgery. A cross-culturally adapted and validated version of the FJS in our language (Italian) was used. Additionally, three other commonly used patient-reported outcome measures for TAA were administered: the American Orthopaedic Foot and Ankle Society (AOFAS) ankle-hindfoot score, the Manchester-Oxford Foot Questionnaire (MOXFQ), and the VAS.

RESULTS

Reliability was demonstrated by excellent internal consistency (Cronbach α coefficient = 0.95) and excellent test-retest reliability (intraclass correlation coefficient = 0.99; standard error of measurement = 2.7). Robust validity was observed, in that the FJS had a strong correlation with the AOFAS ankle-hindfoot score, the MOXFQ, and the VAS (Pearson and Spearman values consistently above 0.7 or below -0.7). Responsiveness to change was observed between 6 and 12 months (Cohen d = 0.37). Low ceiling and floor effects at both 6 months (4% and 3% reached top and bottom scores, respectively) and 12 months (10% and 0% reached top and bottom scores, respectively) were demonstrated, below the recommended 15% interpretability threshold. No association between outcomes and patient gender was observed.

CONCLUSION

Test properties and validity of the FJS were strong in patients who underwent TAA. It seems suitable for clinical use, although future studies should seek to replicate or refute our findings in other patient populations.

LEVEL OF EVIDENCE

Level II, therapeutic study.

Development of standard computerised adaptive test (CAT) settings for the EORTC CAT Core

AIMS

Computerised adaptive test (CAT) provides individualised patient reported outcome measurement while retaining direct comparability of scores across patients and studies. Optimal CAT measurement requires an appropriate CAT-setting, the set of criteria defining the CAT including start item, item selection criterion, and stop criterion. The European Organisation for Research and Treatment of Cancer (EORTC) CAT Core allows for assessing the 14 functional and symptom domains covered by the EORTC QLQ-C30 questionnaire. The aim was to present a general approach for selecting CAT-settings and to use this to develop a portfolio of standard settings for the EORTC CAT Core optimised for different purposes and populations.

METHODS

Using simulations, the measurement properties of CATs of different length and precision were evaluated and compared allowing for identifying the most suitable settings. All CATs were initiated with the most informative QLQ-C30 item. For each domain two fixed-length and two fixed-precision standard CATs were selected focusing on efficiency (brief version) and precision (long), respectively.

RESULTS

The brief fixed-length CATs included 3-5 items each while the long versions included 5-8 items. The fixed-precision CATs aimed for reliability of 0.65-0.95 (brief versions) and 0.85-0.98 (long versions), respectively. Median sample size savings using the CATs compared to the QLQ-C30 scales ranged 20%-31%, although savings varied considerably across the domains.

CONCLUSION

The EORTC CAT Core standard settings simplify selection of relevant and appropriate CATs. The CATs prioritise either brevity and efficiency or precision, but all provide increased measurement precision and hence, reduced sample size requirements compared to the QLQ-C30 scales. The CATs may be used as they are or modified to accommodate specific requirements.

Effectiveness and cost-effectiveness of a web-based routine assessment with integrated recommendations for action for depression and anxiety (RehaCAT+): protocol for a cluster randomised controlled trial for patients with elevated depressive symptoms in rehabilitation facilities

INTRODUCTION

The integration of a web-based computer-adaptive patient-reported outcome test (CAT) platform with persuasive design optimised features including recommendations for action into routine healthcare could provide a promising way to translate reliable diagnostic results into action. This study aims to evaluate the effectiveness and cost-effectiveness of such a platform for depression and anxiety (RehaCAT+) compared with the standard diagnostic system (RehaCAT) in cardiological and orthopaedic health clinics in routine care.

METHODS AND ANALYSIS

A two-arm, pragmatic, cluster-randomised controlled trial will be conducted. Twelve participating rehabilitation clinics in Germany will be randomly assigned to a control (RehaCAT) or experimental group (RehaCAT+) in a 1:1 design. A total sample of 1848 participants will be recruited across all clinics. The primary outcome, depression severity at 12 months follow-up (T3), will be assessed using the CAT Patient-Reported Outcome Measurement Information System Emotional Distress-Depression Item set. Secondary outcomes are depression at discharge (T1) and 6 months follow-up (T2) as well as anxiety, satisfaction with participation in social roles and activities, pain impairment, fatigue, sleep, health-related quality of life, self-efficacy, physical functioning, alcohol, personality and health economic-specific general quality of life and socioeconomic cost and benefits at T1-3. User behaviour, acceptance, facilitating and hindering factors will be assessed with semistructured qualitative interviews. Additionally, a smart sensing substudy will be conducted, with daily ecological momentary assessments and passive collection of smartphone usage variables. Data analysis will follow the intention-to-treat principle with additional per-protocol analyses. Cost-effectiveness analyses will be conducted from a societal perspective and the perspective of the statutory pension insurance.

ETHICS AND DISSEMINATION

The study will be conducted according to the Declaration of Helsinki. The Ethics Committee of Ulm University, has approved the study (on 24 February 2021 ref. 509/20). Written informed consent will be obtained for all participants. Results will be published via peer-reviewed journals.

TRIAL REGISTRATION NUMBER

DRKS00027447.

Patients' and parents' perspective on the implementation of Patient Reported Outcome Measures in pediatric clinical practice using the KLIK PROM portal

INTRODUCTION

The KLIK Patient Reported Outcome Measures (PROM) portal ( www.hetklikt.nu ) has been implemented since 2011 in clinical practice in over 20 Dutch hospitals. Patients and/or parents complete PROMs before the outpatient consultation and answers are subsequently discussed by clinicians during consultation. This study aims to provide insight into patients' and parents' perspective on the use of the KLIK PROM portal in order to optimize its implementation in pediatric clinical practice.

METHODS

Patients (12-19 years) and parents (of children 0-19 years) from the Emma Children's Hospital were invited to participate. A mixed-method design was used; (1) Focus groups were held and analyzed using thematic analysis in psychology, (2) a questionnaire was sent out and analyzed using descriptive statistics.

RESULTS

(1) Eight patients and 17 parents participated. Patients mentioned that KLIK has an attractive layout. However, PROMs were sometimes considered irrelevant and repetitive. Parents valued that KLIK provides insight into their child's functioning, but they were not satisfied with the extent to which PROMs were discussed by clinicians. (2) 31 patients and 130 parents completed the questionnaire. Overall, patients and parents reported a satisfaction score of 7.9/10 and 7.3/10, respectively. 81% of patients and 74% of parents indicated that KLIK is easy to use.

CONCLUSION

Patients and parents are generally satisfied with KLIK, however, points of improvement were mentioned. These are currently being addressed by e.g., upgrading the KLIK website, implementing PROMIS item banks in KLIK to reduce irrelevancy and repetitiveness of PROMs, and implementation strategies to improve the discussion-rate. In this way, implementation of the KLIK PROM portal can be further optimized, with the ultimate goal to improve quality of care.

From statistics to clinics: the visual feedback of PROMIS® CATs

Background

To reduce the burden of completing Patient-Reported Outcome Measures (PROMs), PROMIS® Computerized Adaptive Tests (CATs) are being implemented in pediatric clinical practice. We aimed to develop recommendations for visual feedback options for PROMIS CATs on individual item and domain score level as an evidence-based feedback recommendation for PROMIS CATs is lacking.

Methods

Focus groups were held with clinicians who use the KLIK PROM portal. Literature-based feedback options were provided to initiate group discussion. Data was analyzed using thematic coding method. Additionally, a questionnaire was sent out to assess patients’ (12-18y) and parents’ (child 0-18y) preference for individual item feedback. Data was analyzed using descriptive statistics.

Results

Six focus groups were held (N = 28 clinicians). Regarding individual item feedback, showing the complete item bank, with only responses to administered items in traffic light colors was preferred. For domain scores, line graphs were preferred, including numerical (T-)scores, reference and cut-off lines, and traffic light colors. Separate graphs per domain, ranked in order of importance and harmonization of directionality (‘higher = better’) were considered important. Questionnaire results (N = 31 patients/N = 131 parents) showed that viewing their own item responses was preferred above receiving no item feedback by 58.1% of the patients and 77.1% of the parents.

Conclusions

Based on the outcomes and after discussion with the Dutch-Flemish PROMIS National Center, recommendations for PROMIS CAT feedback options were developed. PROMIS CATs can now be used in clinical practice to help clinicians monitor patient outcomes, while reducing the burden of completing PROMs for patients significantly.

Incorporating patient centered benefits as endpoints in randomized trials of maintenance therapies in advanced ovarian cancer: A position paper from the GCIG symptom benefit committee

BACKGROUND

Quality of life and patient reported outcome measures (PROMs) are important secondary endpoints and incorporated in most contemporary clinical trials. There have been deficiencies in their assessment and reporting in ovarian cancer clinical trials, particularly in trials of maintenance treatment where they are of particular importance. The Gynecologic Cancer InterGroup (GCIG) symptom benefit committee (SBC) recently convened a brainstorming meeting with representation from all collaborative groups to address questions of how to best incorporate PROMs into trials of maintenance therapies to support the primary endpoint which is usually progression free survival (PFS). These recommendations should harmonize the collection, analysis and reporting of PROM's across future GCIG trials.

METHODS

Through literature review, trials analysis and input from international experts, the SBC identified four relevant topics to address with respect to promoting the role of PROMs to support the PFS endpoint in clinical trials of maintenance treatment for OC.

RESULTS

The GCIG SBC unanimously accepted the importance of integrating PROM's in future maintenance trials and developed four guiding principles to be considered early in trial design. These include 1) adherence to SPIRIT-PRO guidelines, 2) harmonization of selection, collection and reporting of PROM's; 3) combining Health Related Quality of Life (HRQL) measures with clinical endpoints and 4) common approaches to dealing with incomplete HRQL data.

CONCLUSIONS

Close attention to incorporating HRQL and PROM's is critical to interpret the results of ovarian cancer clinical trials of maintenance therapies. There should be a consistent approach to assessing and reporting patient centered benefits across all GCIG trials to enable cross trial comparisons which can be used to inform practice.